2020-11-20T11:05:21.116 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:05:21.118 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi --block --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/ffsb} --verbose --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245 --lock -- /tmp/teuthology-worker.0o3jvgwn.tmp 2020-11-20T11:05:21.215 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:05:21.294 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/ffsb} email: pdonnell@redhat.com first_in_suite: false job_id: '5640245' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - SLOW_OPS - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/ffsb.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.3608 2020-11-20T11:05:21.295 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:05:21.296 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:05:21.296 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:05:21.300 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:05:21.319 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:05:21.320 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:05:21.320 INFO:teuthology.packaging:ref: None 2020-11-20T11:05:21.321 INFO:teuthology.packaging:tag: None 2020-11-20T11:05:21.321 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:05:21.321 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:05:21.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:05:21.507 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T11:05:21.508 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:05:21.518 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:05:21.519 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:05:21.571 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:05:21.572 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:05:21.638 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:31.656 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:41.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:51.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:01.749 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:11.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:21.780 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:31.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:41.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:51.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:01.869 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:11.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:21.902 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:31.918 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:41.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:07:51.954 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:08:01.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:08:11.990 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:08:22.006 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:08:32.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:08:42.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:08:52.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:09:02.085 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:09:12.099 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:09:22.114 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:09:32.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:09:42.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:09:52.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:02.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:12.198 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:22.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:32.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:42.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:10:52.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:02.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:12.300 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:22.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:32.335 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:42.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:11:52.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:02.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:12.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:22.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:32.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:42.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:12:52.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:02.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:12.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:22.547 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:32.573 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:42.596 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:13:52.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:02.653 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:12.672 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:22.691 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:32.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:42.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:14:52.753 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:15:02.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:15:12.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:15:22.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:15:32.831 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:15:42.855 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:15:52.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:16:02.899 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:16:12.928 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:16:22.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:16:32.962 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:16:42.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:16:52.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:17:03.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:17:13.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:17:23.044 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:17:33.063 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:17:43.078 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245'} 2020-11-20T11:17:43.098 DEBUG:teuthology.lock.ops:locked ubuntu@smithi105.front.sepia.ceph.com, ubuntu@smithi100.front.sepia.ceph.com, ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:17:43.172 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f514c4bdea0>, signals=[15]) 2020-11-20T11:17:43.376 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.1 2020-11-20T11:17:43.379 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 8.1 2020-11-20T11:17:43.392 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.1 2020-11-20T11:17:43.749 INFO:teuthology.orchestra.console:Power off smithi067 2020-11-20T11:17:43.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:17:43.762 INFO:teuthology.orchestra.console:Power off smithi100 2020-11-20T11:17:43.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:17:43.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:43.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:43.796 INFO:teuthology.orchestra.console:Power off smithi105 2020-11-20T11:17:43.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:17:43.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:47.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:47.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:47.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:51.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:52.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:52.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:52.748 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2020-11-20T11:17:52.760 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2020-11-20T11:17:52.850 INFO:teuthology.orchestra.console:Power on smithi100 2020-11-20T11:17:52.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:17:52.861 INFO:teuthology.orchestra.console:Power on smithi067 2020-11-20T11:17:52.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:17:52.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:52.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:56.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:56.888 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2020-11-20T11:17:56.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:56.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:17:56.990 INFO:teuthology.orchestra.console:Power on smithi105 2020-11-20T11:17:56.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:17:57.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:18:01.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:18:01.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:18:01.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:18:01.280 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2020-11-20T11:18:01.382 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2020-11-20T11:18:01.386 INFO:teuthology.orchestra.console:Power on for smithi100 completed 2020-11-20T11:18:01.488 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2020-11-20T11:18:05.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:18:05.358 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2020-11-20T11:18:05.461 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2020-11-20T11:20:32.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:35.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:36.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:44.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:44.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:45.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:53.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:53.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:20:54.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:02.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:02.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:03.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:11.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:11.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:12.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:20.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:21.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:21.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:30.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:30.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:30.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:21:39.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:36.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:36.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:36.950 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:22:36.952 INFO:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:22:36.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:22:36.980 INFO:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:22:37.264 INFO:teuthology.provision.fog.smithi100:Node is ready 2020-11-20T11:22:37.264 INFO:teuthology.orchestra.run.smithi100:> hostname 2020-11-20T11:22:37.280 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2020-11-20T11:22:37.281 INFO:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2020-11-20T11:22:37.301 INFO:teuthology.provision.fog.smithi067:Node is ready 2020-11-20T11:22:37.301 INFO:teuthology.orchestra.run.smithi067:> hostname 2020-11-20T11:22:37.315 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2020-11-20T11:22:37.316 INFO:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2020-11-20T11:22:37.336 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2020-11-20T11:22:37.336 INFO:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2020-11-20T11:22:37.371 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2020-11-20T11:22:37.371 INFO:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2020-11-20T11:22:37.449 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2020-11-20T11:22:37.478 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2020-11-20T11:22:37.499 INFO:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2020-11-20T11:22:37.530 INFO:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2020-11-20T11:22:37.547 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2020-11-20T11:22:37.601 INFO:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2020-11-20T11:22:37.615 INFO:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2020-11-20T11:22:37.672 INFO:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2020-11-20T11:22:37.682 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2020-11-20T11:22:37.683 DEBUG:teuthology.parallel:result is None 2020-11-20T11:22:37.742 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2020-11-20T11:22:37.743 DEBUG:teuthology.parallel:result is None 2020-11-20T11:22:47.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:47.272 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:22:47.273 INFO:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:22:47.571 INFO:teuthology.provision.fog.smithi105:Node is ready 2020-11-20T11:22:47.571 INFO:teuthology.orchestra.run.smithi105:> hostname 2020-11-20T11:22:47.585 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2020-11-20T11:22:47.586 INFO:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2020-11-20T11:22:47.640 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2020-11-20T11:22:47.641 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-11-20T11:22:47.737 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2020-11-20T11:22:47.765 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2020-11-20T11:22:47.832 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2020-11-20T11:22:47.899 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-11-20T11:22:47.965 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2020-11-20T11:22:47.966 DEBUG:teuthology.parallel:result is None 2020-11-20T11:22:48.106 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2020-11-20T11:22:48.107 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:22:48.124 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2020-11-20T11:22:48.124 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:22:48.138 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2020-11-20T11:22:48.139 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:22:48.153 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:22:48.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:22:48.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:48.221 INFO:teuthology.orchestra.run.smithi105:> true 2020-11-20T11:22:48.375 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-11-20T11:22:48.428 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-11-20T11:22:48.428 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-11-20T11:22:48.481 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-11-20T11:22:48.482 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-11-20T11:22:48.482 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-11-20T11:22:48.482 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:48.482 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-11-20T11:22:48.483 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:48.483 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:48.483 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:48.483 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:48.484 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:48.485 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:48.485 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:22:48.486 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-11-20T11:22:48.504 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:22:48.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:22:48.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:48.574 INFO:teuthology.orchestra.run.smithi100:> true 2020-11-20T11:22:48.739 INFO:teuthology.orchestra.run.smithi100:> uname -m 2020-11-20T11:22:48.792 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2020-11-20T11:22:48.793 INFO:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2020-11-20T11:22:48.849 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Linux" 2020-11-20T11:22:48.849 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8 (Core)" 2020-11-20T11:22:48.850 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2020-11-20T11:22:48.850 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:48.850 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2020-11-20T11:22:48.850 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:48.851 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:48.851 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:48.852 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:48.852 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:48.852 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:48.852 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:22:48.853 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:48.853 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:48.853 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:48.853 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:48.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:22:48.854 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2020-11-20T11:22:48.876 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:22:48.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:22:48.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:49.021 INFO:teuthology.orchestra.run.smithi067:> true 2020-11-20T11:22:49.208 INFO:teuthology.orchestra.run.smithi067:> uname -m 2020-11-20T11:22:49.264 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2020-11-20T11:22:49.264 INFO:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2020-11-20T11:22:49.319 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Linux" 2020-11-20T11:22:49.319 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8 (Core)" 2020-11-20T11:22:49.319 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2020-11-20T11:22:49.320 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:49.320 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2020-11-20T11:22:49.320 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:49.320 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:49.320 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:49.321 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:49.321 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:49.321 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:49.321 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:22:49.321 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:49.322 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:49.322 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:49.322 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:49.322 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:22:49.323 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2020-11-20T11:22:49.338 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T11:22:49.393 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiiVYDQdzWTCL+kV4EuCRNXf+DuWSUrabcyBHQlvPwarDKIJ2NqLRd6asZxy1s8mYO8qow3GXOay8k3F2NKJAGuDtZ7vcGGRubMDqyZf7holSPC7U3FPDcU8CplOLEy38X3Q13ifQCEh5HCyMBuGxkpDxcD4j60uqMQeCPk0YEdvHv4eeNHQn/cVKnv71pervOdIhECSHyjZfmMU16sAS/rq8fXBGI3AF+ntolb6PZZ/iE5G5uJh1ss9fXseu7UzR+vl58nypsFuzpC3CYTJIsWuuNaCkTqsnu68pglzI0Q2hG7hN+fw5tazf50zRsFXHfz8rlqlVfRoJHsdghfdGOn+V4umf6b5QQqfRbm9H9Q3y3OC+OVkQNlKB9nbMKLPacnm0h3WIuGoqLt3oqJb02PQyKma1ww6QHDPQkfo0NfkXGaCsLASLCBSM86jnzLiXIZHL1fNCSy3iqR35Wb0mpE053i8j7IYITdQ8YWJYgMB7UBvTWak9AKUQoUfhQE9U= smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr7+mirjO4XZaOjvgvpGbajZxokCD+gUPA/vZi6BEQwgXkmW+yOLepRsXxw/0MO5C1lfQAD16/0TPg6l8gcbueuWUyxHOuPCCdayOnpsE9Hg4qWknAC1Oz9rgW9A7byLUk3G00b1CUx9gV/8FzBa8ueDyiLssO+oioGFLdRUlGxyNuxzAvM1s7BsYBZ7iq19k8U5jxD+TL6Hj+WjLphMZdGRYh1c7PdDXo8OxtNudeDk7OFQqkUF+hVZp7IzgioGXqUq1WB2ZZz2avrffRwzfvhulNM6U04bpgbMdZchdMZSZe1Kq03JaMtn5YasrB6QdQB8V0dthzYBzCvmmOGbnctK8r1jG2plZ2tz8qGtKDelG+ED7m6GqGprQUxM5cJbU4LbB3u04nrAk+wOWp5bueao4xOgnVEDPye5A+F/s7XDMbXUiRCPP54SdXR7L+6zt1kLHKGXY12YxlZMKePJIfYm+WDpUwAzBeslTKjWGrGw/mSTe/GPhDav7QSFjjIxs= smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkPAjMQhO9TV4SJKimAvJ/BKn7jGvoGoRyL7y3a21BrljFkuyzFdE9gLS0R3D5FdBRS/dRCbGUkDIgWszOoyXRouDS3q2yVzBBK+45Zo5PejBfqn1KR4JGljVkKELxYtLYD7VJQMjzuPcSo0kENPmxhpRmTwEor2+vdNGEJyvWRNyyDu61xyfZGL5saJjcBg/ajCUeYaWg0R1gRHlLGNl+2YVhoGEF0HJ/nqkoa3mNBXXjEO10pF6gzintzonQsw4iBmhOYK2Fl+GlpNVXFJHGZY4N15ouHWJTTUvD7q7EKz/OeH2R60b7ZZq6FQVWT2oZJuNoyjP2/ydSLncDIFiwldsGZiKwXh1/0lsI9q4Oc8dH/79azLxB4KO81nSvKRtlH1kPBgFLwrHOhqB6ZREPjrzZBmREppcftBUDWCcUDxMpcktSZOdXY4NNANx0MHeV57GW7Ew9pI860XE+zO8QOSGawaA+M5GOGpSjhpksPLEazlmP2/SZGt6X2q+NDgk= 2020-11-20T11:22:49.393 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:22:49.451 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T11:22:49.454 INFO:teuthology.task.internal:Saving configuration 2020-11-20T11:22:49.474 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T11:22:49.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T11:22:49.499 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:17:43.083433', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQXAPHb4ImeghGelu9iyCWEgf8hZGTmB3dlCOZf77N7M9H7jaCrNhMMwvxHS5tsWRX7+vmZMIs+yXaKtuYS9vo=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi105.front.sepia.ceph.com'} 2020-11-20T11:22:49.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:17:43.083454', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnwpybgUn1zOO8QbayTdCj0NagZzu268Bn+ZfpRxxLHlGJl0lVQNmnTimD87XZq/vnp7LOI9eTtBLhk4mpRFlY=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi100.front.sepia.ceph.com'} 2020-11-20T11:22:49.531 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:17:43.083471', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2YzIVv4tNMNiLhwuQ7v0ezeId9w4v5L6l+hM6qh3GzqD6ROK9KmrgJq8lW8lAKxRSusRWzFPHJjsHAWheilcQ=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi067.front.sepia.ceph.com'} 2020-11-20T11:22:49.531 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T11:22:49.540 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T11:22:49.540 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T11:22:49.541 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T11:22:49.541 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T11:22:49.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f514c4bda60>, signals=[15]) 2020-11-20T11:22:49.628 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T11:22:49.638 INFO:teuthology.task.internal:Opening connections... 2020-11-20T11:22:49.638 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:22:49.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:49.714 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:22:49.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:49.788 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:22:49.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:22:49.865 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T11:22:49.873 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-11-20T11:22:49.889 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-11-20T11:22:49.890 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-11-20T11:22:49.942 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-11-20T11:22:49.943 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-11-20T11:22:49.943 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-11-20T11:22:49.943 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:49.943 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-11-20T11:22:49.944 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:49.944 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:49.944 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:49.944 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:49.944 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:49.945 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:49.945 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:22:49.945 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:49.945 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:49.946 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:49.946 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:49.946 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:22:49.946 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-11-20T11:22:49.963 INFO:teuthology.orchestra.run.smithi100:> uname -m 2020-11-20T11:22:49.983 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2020-11-20T11:22:49.984 INFO:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2020-11-20T11:22:50.057 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Linux" 2020-11-20T11:22:50.057 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8 (Core)" 2020-11-20T11:22:50.058 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2020-11-20T11:22:50.058 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:50.058 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2020-11-20T11:22:50.058 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:50.058 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:50.059 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:50.059 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:50.059 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:50.059 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:22:50.060 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:50.060 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:50.060 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:50.060 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:22:50.061 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2020-11-20T11:22:50.080 INFO:teuthology.orchestra.run.smithi067:> uname -m 2020-11-20T11:22:50.107 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2020-11-20T11:22:50.108 INFO:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2020-11-20T11:22:50.163 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Linux" 2020-11-20T11:22:50.163 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8 (Core)" 2020-11-20T11:22:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2020-11-20T11:22:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2020-11-20T11:22:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2020-11-20T11:22:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:22:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T11:22:50.165 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2020-11-20T11:22:50.165 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T11:22:50.165 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T11:22:50.165 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T11:22:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:22:50.166 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T11:22:50.166 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T11:22:50.166 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T11:22:50.166 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T11:22:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:22:50.167 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2020-11-20T11:22:50.194 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T11:22:50.246 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T11:22:50.277 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T11:22:50.278 INFO:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:22:50.284 INFO:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:22:50.298 INFO:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:22:50.323 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T11:22:50.339 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T11:22:50.339 INFO:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:22:50.364 INFO:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:22:50.392 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T11:22:50.470 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T11:22:50.489 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.9': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'osd.10': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.z': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.8': {'kdb': True, 'sha1': 'distro'}, 'osd.11': {'kdb': True, 'sha1': 'distro'}} 2020-11-20T11:22:50.490 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-20T11:22:50.490 INFO:teuthology.orchestra.run.smithi105:> uname -r 2020-11-20T11:22:50.508 INFO:teuthology.orchestra.run.smithi105.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:22:50.508 INFO:teuthology.task.kernel:Running kernel on smithi105: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:22:50.509 INFO:teuthology.orchestra.run.smithi105:> sudo yum install -y kernel 2020-11-20T11:22:53.082 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - AppStream 33 MB/s | 7.0 MB 00:00 2020-11-20T11:22:54.297 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Base 22 MB/s | 2.2 MB 00:00 2020-11-20T11:22:54.739 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Extras 76 kB/s | 5.5 kB 00:00 2020-11-20T11:22:57.630 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.3 MB 00:00 2020-11-20T11:22:57.630 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 5.3 MB/s | 23 kB 00:00 2020-11-20T11:22:57.790 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-20T11:22:57.790 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2020-11-20T11:22:57.946 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-11-20T11:22:57.947 INFO:teuthology.orchestra.run.smithi105.stdout:Nothing to do. 2020-11-20T11:22:57.948 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2020-11-20T11:22:58.055 INFO:teuthology.orchestra.run.smithi105:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:22:58.459 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:22:56 AM UTC. 2020-11-20T11:22:58.709 INFO:teuthology.orchestra.run.smithi105.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:22:58.709 INFO:teuthology.orchestra.run.smithi105.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:22:58.764 INFO:teuthology.orchestra.run.smithi105.stderr:Error: No packages marked for reinstall. 2020-11-20T11:22:58.810 INFO:teuthology.orchestra.run.smithi105:> sudo yum reinstall -y kernel || true 2020-11-20T11:22:59.211 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Nov 2020 11:22:56 AM UTC. 2020-11-20T11:22:59.476 INFO:teuthology.orchestra.run.smithi105.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:22:59.477 INFO:teuthology.orchestra.run.smithi105.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi105.stderr:Error: No packages marked for reinstall. 2020-11-20T11:22:59.560 INFO:teuthology.orchestra.run.smithi105:> rpm -q kernel --last | head -n 1 2020-11-20T11:22:59.620 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-4.18.0-193.28.1.el8_2.x86_64 Sun 15 Nov 2020 12:12:26 PM UTC 2020-11-20T11:22:59.621 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:22:59.621 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:22:59.621 INFO:teuthology.orchestra.run.smithi100:> uname -r 2020-11-20T11:22:59.638 INFO:teuthology.orchestra.run.smithi100.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:22:59.638 INFO:teuthology.task.kernel:Running kernel on smithi100: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:22:59.638 INFO:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2020-11-20T11:23:02.941 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - AppStream 8.1 MB/s | 7.0 MB 00:00 2020-11-20T11:23:04.167 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-11-20T11:23:04.618 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Extras 70 kB/s | 5.5 kB 00:00 2020-11-20T11:23:05.051 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.3 MB 00:00 2020-11-20T11:23:06.766 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 5.5 MB/s | 23 kB 00:00 2020-11-20T11:23:07.668 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-20T11:23:07.668 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2020-11-20T11:23:07.829 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-11-20T11:23:07.832 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2020-11-20T11:23:07.832 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2020-11-20T11:23:07.963 INFO:teuthology.orchestra.run.smithi100:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:23:08.405 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:23:06 AM UTC. 2020-11-20T11:23:08.652 INFO:teuthology.orchestra.run.smithi100.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:23:08.652 INFO:teuthology.orchestra.run.smithi100.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:23:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:Error: No packages marked for reinstall. 2020-11-20T11:23:08.763 INFO:teuthology.orchestra.run.smithi100:> sudo yum reinstall -y kernel || true 2020-11-20T11:23:09.171 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Nov 2020 11:23:06 AM UTC. 2020-11-20T11:23:09.434 INFO:teuthology.orchestra.run.smithi100.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:23:09.435 INFO:teuthology.orchestra.run.smithi100.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:23:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:Error: No packages marked for reinstall. 2020-11-20T11:23:09.538 INFO:teuthology.orchestra.run.smithi100:> rpm -q kernel --last | head -n 1 2020-11-20T11:23:09.596 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-4.18.0-193.28.1.el8_2.x86_64 Sun 15 Nov 2020 12:12:26 PM UTC 2020-11-20T11:23:09.597 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:23:09.598 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:23:09.599 INFO:teuthology.orchestra.run.smithi067:> uname -r 2020-11-20T11:23:09.631 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:23:09.631 INFO:teuthology.task.kernel:Running kernel on smithi067: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:23:09.632 INFO:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2020-11-20T11:23:12.292 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-11-20T11:23:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-11-20T11:23:14.007 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Extras 84 kB/s | 5.5 kB 00:00 2020-11-20T11:23:14.387 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 25 MB/s | 8.3 MB 00:00 2020-11-20T11:23:16.277 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 5.1 MB/s | 23 kB 00:00 2020-11-20T11:23:17.228 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-20T11:23:17.228 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2020-11-20T11:23:17.399 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2020-11-20T11:23:17.401 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2020-11-20T11:23:17.402 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2020-11-20T11:23:17.546 INFO:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:23:17.980 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:23:16 AM UTC. 2020-11-20T11:23:18.252 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:23:18.252 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:23:18.323 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2020-11-20T11:23:18.369 INFO:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2020-11-20T11:23:18.802 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:23:16 AM UTC. 2020-11-20T11:23:19.074 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T11:23:19.290 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T11:23:19.292 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2020-11-20T11:23:19.292 INFO:teuthology.orchestra.run.smithi067:> rpm -q kernel --last | head -n 1 2020-11-20T11:23:19.357 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-193.28.1.el8_2.x86_64 Sun 15 Nov 2020 12:12:26 PM UTC 2020-11-20T11:23:19.358 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T11:23:19.359 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:23:19.359 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-20T11:23:19.359 INFO:teuthology.orchestra.run.smithi105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:23:19.441 INFO:teuthology.orchestra.run.smithi105.stdout:ttyS1 2020-11-20T11:23:19.457 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-20T11:23:19.457 INFO:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:23:19.501 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2020-11-20T11:23:19.520 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2020-11-20T11:23:19.521 INFO:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:23:19.560 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2020-11-20T11:23:19.572 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T11:23:19.590 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T11:23:19.591 INFO:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:23:19.652 INFO:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:23:19.663 INFO:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:23:19.683 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T11:23:19.702 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T11:23:19.747 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T11:23:19.748 INFO:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:23:19.753 INFO:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:23:19.779 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:23:19.823 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T11:23:19.841 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T11:23:19.841 INFO:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:23:19.846 INFO:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:23:19.867 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:23:19.889 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.906 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.907 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.921 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.931 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.946 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:23:19.947 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T11:23:19.968 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T11:23:19.969 INFO:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:23:19.975 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:23:19.985 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:23:20.020 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T11:23:20.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T11:23:20.035 INFO:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:23:20.050 INFO:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:23:20.062 INFO:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:23:20.082 INFO:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.162 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.220 INFO:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.294 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.346 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:23:20.347 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:20.399 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:20.413 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:23:20.413 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:23:20.413 INFO:teuthology.orchestra.run.smithi105.stderr:152 bytes copied, 2.8944e-05 s, 5.3 MB/s 2020-11-20T11:23:20.414 INFO:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.451 INFO:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.510 INFO:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.586 INFO:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.637 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:23:20.638 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:20.691 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:23:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:23:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:152 bytes copied, 3.1523e-05 s, 4.8 MB/s 2020-11-20T11:23:20.706 INFO:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.742 INFO:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:23:20.805 INFO:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.905 INFO:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:23:20.964 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:23:20.966 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:21.025 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:23:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:23:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:23:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:152 bytes copied, 3.9011e-05 s, 3.9 MB/s 2020-11-20T11:23:21.045 INFO:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2020-11-20T11:23:21.100 INFO:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2020-11-20T11:23:21.108 INFO:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2020-11-20T11:23:21.191 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:23:21.193 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:23:21.210 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:23:21.650 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T11:23:21.658 INFO:teuthology.task.internal:Starting timer... 2020-11-20T11:23:21.658 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T11:23:21.673 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T11:23:21.717 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T11:23:21.718 INFO:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2020-11-20T11:23:21.791 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: [ OK ] 2020-11-20T11:23:21.793 INFO:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2020-11-20T11:23:21.866 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: [ OK ] 2020-11-20T11:23:21.867 INFO:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2020-11-20T11:23:21.926 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: [ OK ] 2020-11-20T11:23:21.928 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T11:23:21.928 INFO:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2020-11-20T11:23:21.948 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2020-11-20T11:23:21.949 INFO:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2020-11-20T11:23:21.971 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2020-11-20T11:23:21.971 INFO:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2020-11-20T11:23:21.996 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2020-11-20T11:23:21.996 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi067.front.sepia.ceph.com': 'permissive'} 2020-11-20T11:23:21.997 INFO:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:23:22.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:23:22.027 INFO:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:23:22.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:23:22.059 INFO:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:23:22.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:23:22.097 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T11:23:22.097 INFO:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:23:22.135 INFO:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:23:22.166 INFO:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:23:22.202 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T11:23:22.210 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T11:23:22.211 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T11:23:22.223 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T11:23:22.224 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi105.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T11:23:22.592 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T11:23:23.492 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T11:23:26.014 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T11:23:26.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:26 +0000 (0:00:00.068) 0:00:00.068 ******* 2020-11-20T11:23:26.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:26 +0000 (0:00:00.012) 0:00:00.081 ******* 2020-11-20T11:23:26.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:26 +0000 (0:00:00.013) 0:00:00.095 ******* 2020-11-20T11:23:27.515 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi067.front.sepia.ceph.com] 2020-11-20T11:23:27.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:27 +0000 (0:00:01.544) 0:00:01.640 ******* 2020-11-20T11:23:27.620 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] 2020-11-20T11:23:27.701 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:27 +0000 (0:00:00.095) 0:00:01.736 ******* 2020-11-20T11:23:27.916 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T11:23:27.918 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:23:27.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:27 +0000 (0:00:00.254) 0:00:01.990 ******* 2020-11-20T11:23:27.961 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:23:27.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:27 +0000 (0:00:00.044) 0:00:02.034 ******* 2020-11-20T11:23:28.367 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T11:23:28.369 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:23:28.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:28 +0000 (0:00:00.404) 0:00:02.438 ******* 2020-11-20T11:23:28.410 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:23:28.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:28 +0000 (0:00:00.041) 0:00:02.480 ******* 2020-11-20T11:23:28.451 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T11:23:28.453 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:28.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:28 +0000 (0:00:00.040) 0:00:02.520 ******* 2020-11-20T11:23:28.492 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:28.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:28 +0000 (0:00:00.042) 0:00:02.563 ******* 2020-11-20T11:23:28.548 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi100.front.sepia.ceph.com] 2020-11-20T11:23:28.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:28 +0000 (0:00:00.090) 0:00:02.654 ******* 2020-11-20T11:23:28.792 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T11:23:29.647 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Friday 20 November 2020 11:23:28 +0000 (0:00:00.215) 0:00:02.869 ******* ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} Friday 20 November 2020 11:23:28 +0000 (0:00:00.044) 0:00:02.914 ******* Friday 20 November 2020 11:23:28 +0000 (0:00:00.030) 0:00:02.944 ******* TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi100.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} Friday 20 November 2020 11:23:29 +0000 (0:00:00.286) 0:00:03.230 ******* TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:23:29 +0000 (0:00:00.059) 0:00:03.290 ******* TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Friday 20 November 2020 11:23:29 +0000 (0:00:00.223) 0:00:03.513 ******* 2020-11-20T11:23:29.705 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T11:23:29.707 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871408.84806-35192783178739/source", "state": "file", "uid": 0} 2020-11-20T11:23:29.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:29 +0000 (0:00:00.261) 0:00:03.775 ******* 2020-11-20T11:23:29.747 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871408.89156-144196751034251/source", "state": "file", "uid": 0} 2020-11-20T11:23:29.783 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:29 +0000 (0:00:00.043) 0:00:03.818 ******* 2020-11-20T11:23:30.052 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871409.4923348-172053466080360/source", "state": "file", "uid": 0} 2020-11-20T11:23:30.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:30 +0000 (0:00:00.303) 0:00:04.122 ******* 2020-11-20T11:23:30.124 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T11:23:30.126 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:23:30.128 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:23:30.162 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:23:30.163 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:23:30.326 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:23:30.328 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:23:30.414 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T11:23:30.422 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T11:23:30.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:30 +0000 (0:00:00.481) 0:00:04.603 ******* 2020-11-20T11:23:30.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:30 +0000 (0:00:00.030) 0:00:04.634 ******* 2020-11-20T11:23:30.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:30 +0000 (0:00:00.031) 0:00:04.665 ******* 2020-11-20T11:23:31.227 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi067.front.sepia.ceph.com] 2020-11-20T11:23:31.271 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] 2020-11-20T11:23:31.313 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T11:23:31.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.682) 0:00:05.348 ******* 2020-11-20T11:23:31.347 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] 2020-11-20T11:23:31.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.075) 0:00:05.423 ******* 2020-11-20T11:23:31.460 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.071) 0:00:05.495 ******* 2020-11-20T11:23:31.797 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T11:23:31.799 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.163632", "end": "2020-11-20 11:23:31.768675", "rc": 0, "start": "2020-11-20 11:23:31.605043", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} changed: [smithi105.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.152351", "end": "2020-11-20 11:23:31.774619", "rc": 0, "start": "2020-11-20 11:23:31.622268", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:23:31.800 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172284", "end": "2020-11-20 11:23:31.777006", "rc": 0, "start": "2020-11-20 11:23:31.604722", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:23:31.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.375) 0:00:05.870 ******* 2020-11-20T11:23:31.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.035) 0:00:05.905 ******* 2020-11-20T11:23:31.905 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:31 +0000 (0:00:00.034) 0:00:05.940 ******* 2020-11-20T11:23:32.047 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:23:32.049 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008229", "end": "2020-11-20 11:23:32.021008", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:32.012779", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:23:32.083 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.177) 0:00:06.118 ******* 2020-11-20T11:23:32.090 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013078", "end": "2020-11-20 11:23:32.045015", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:32.031937", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:23:32.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.045) 0:00:06.163 ******* 2020-11-20T11:23:32.137 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:23:32.139 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:23:32.140 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.023906", "end": "2020-11-20 11:23:32.097278", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:32.073372", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:23:32.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.046) 0:00:06.210 ******* 2020-11-20T11:23:32.435 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.040) 0:00:06.251 ******* TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:23:32 +0000 (0:00:00.054) 0:00:06.305 ******* Friday 20 November 2020 11:23:32 +0000 (0:00:00.048) 0:00:06.354 ******* TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:23:32 +0000 (0:00:00.056) 0:00:06.410 ******* Friday 20 November 2020 11:23:32 +0000 (0:00:00.031) 0:00:06.441 ******* TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.450 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.042) 0:00:06.484 ******* 2020-11-20T11:23:32.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.030) 0:00:06.515 ******* 2020-11-20T11:23:32.486 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:23:32.488 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.040) 0:00:06.555 ******* 2020-11-20T11:23:32.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.029) 0:00:06.585 ******* 2020-11-20T11:23:32.557 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.040) 0:00:06.625 ******* 2020-11-20T11:23:32.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.030) 0:00:06.656 ******* 2020-11-20T11:23:32.628 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:23:32.630 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.040) 0:00:06.697 ******* 2020-11-20T11:23:32.669 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:23:32.670 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.671 INFO:teuthology.task.ansible.out:TASK [users : Filter the managed_users list] *********************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.671 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.671 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.673 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-11-20T11:23:32.676 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.046) 0:00:06.743 ******* 2020-11-20T11:23:32.715 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.716 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.717 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansib 2020-11-20T11:23:32.719 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.754 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.044) 0:00:06.787 ******* 2020-11-20T11:23:32.758 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.760 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIw 2020-11-20T11:23:32.761 INFO:teuthology.task.ansible.out:AAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d6932535 2020-11-20T11:23:32.763 INFO:teuthology.task.ansible.out:11d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac02 2020-11-20T11:23:32.766 INFO:teuthology.task.ansible.out:16a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.044) 0:00:06.832 ******* 2020-11-20T11:23:32.803 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.805 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.806 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96 2020-11-20T11:23:32.809 INFO:teuthology.task.ansible.out:a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2020-11-20T11:23:32.811 INFO:teuthology.task.ansible.out: "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.844 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.046) 0:00:06.879 ******* 2020-11-20T11:23:32.850 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.851 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.853 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.853 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.853 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.855 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.855 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.856 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nwatkin 2020-11-20T11:23:32.857 INFO:teuthology.task.ansible.out:s', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c14471 2020-11-20T11:23:32.859 INFO:teuthology.task.ansible.out:2bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.047) 0:00:06.927 ******* 2020-11-20T11:23:32.898 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.900 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.902 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.902 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@ 2020-11-20T11:23:32.904 INFO:teuthology.task.ansible.out:trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.938 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:32 +0000 (0:00:00.045) 0:00:06.973 ******* 2020-11-20T11:23:32.944 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.946 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.948 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.948 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed" 2020-11-20T11:23:32.950 INFO:teuthology.task.ansible.out:: false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.961 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.964 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_l 2020-11-20T11:23:32.966 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.975 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.976 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.989 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:32.991 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.000 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c 2020-11-20T11:23:33.004 INFO:teuthology.task.ansible.out:68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Co 2020-11-20T11:23:33.006 INFO:teuthology.task.ansible.out:nditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4V 2020-11-20T11:23:33.008 INFO:teuthology.task.ansible.out:ie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.018 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.020 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a8 2020-11-20T11:23:33.022 INFO:teuthology.task.ansible.out:7cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.022 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_rea 2020-11-20T11:23:33.024 INFO:teuthology.task.ansible.out:son": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.034 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.035 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 2 2020-11-20T11:23:33.037 INFO:teuthology.task.ansible.out:0058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.048 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.050 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReC 2020-11-20T11:23:33.051 INFO:teuthology.task.ansible.out:atMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316 2020-11-20T11:23:33.053 INFO:teuthology.task.ansible.out:d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.062 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.065 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@f 2020-11-20T11:23:33.067 INFO:teuthology.task.ansible.out:edora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935 2020-11-20T11:23:33.068 INFO:teuthology.task.ansible.out:af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.078 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.079 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf" 2020-11-20T11:23:33.081 INFO:teuthology.task.ansible.out:, "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.083 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.083 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.084 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2020-11-20T11:23:33.086 INFO:teuthology.task.ansible.out:"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.095 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.097 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.098 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.098 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.098 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': ' 2020-11-20T11:23:33.100 INFO:teuthology.task.ansible.out:yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuM 2020-11-20T11:23:33.102 INFO:teuthology.task.ansible.out:A c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e16492 2020-11-20T11:23:33.103 INFO:teuthology.task.ansible.out:7ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.112 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.114 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.114 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.115 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.115 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1 2020-11-20T11:23:33.118 INFO:teuthology.task.ansible.out:WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3 2020-11-20T11:23:33.119 INFO:teuthology.task.ansible.out:f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditio 2020-11-20T11:23:33.121 INFO:teuthology.task.ansible.out:nal result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.131 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.132 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.135 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.137 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.148 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.150 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@m 2020-11-20T11:23:33.151 INFO:teuthology.task.ansible.out:agrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.162 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2 2020-11-20T11:23:33.164 INFO:teuthology.task.ansible.out:e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd42952 2020-11-20T11:23:33.165 INFO:teuthology.task.ansible.out:78d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.177 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.179 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.179 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.180 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts" 2020-11-20T11:23:33.181 INFO:teuthology.task.ansible.out:, "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.193 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.194 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.210 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzar 2020-11-20T11:23:33.213 INFO:teuthology.task.ansible.out:zyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYA 2020-11-20T11:23:33.215 INFO:teuthology.task.ansible.out:ARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.224 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.227 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@leno 2020-11-20T11:23:33.229 INFO:teuthology.task.ansible.out:vot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039 2020-11-20T11:23:33.230 INFO:teuthology.task.ansible.out:212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.240 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.242 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.254 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.256 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.257 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.260 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'na 2020-11-20T11:23:33.262 INFO:teuthology.task.ansible.out:me': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.271 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.273 INFO:teuthology.task.ansible.out: skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.274 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.287 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.289 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.300 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.302 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.303 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1 2020-11-20T11:23:33.304 INFO:teuthology.task.ansible.out:108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.306 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.310 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": 2020-11-20T11:23:33.315 INFO:teuthology.task.ansible.out: "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": 2020-11-20T11:23:33.317 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.321 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.322 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.326 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.326 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.326 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.328 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.339 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.343 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, " 2020-11-20T11:23:33.345 INFO:teuthology.task.ansible.out:item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.356 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.357 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.360 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.362 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.363 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.365 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.367 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.367 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.368 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.370 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.371 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.371 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.373 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.375 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovp 2020-11-20T11:23:33.378 INFO:teuthology.task.ansible.out:n": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.397 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.401 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": 2020-11-20T11:23:33.403 INFO:teuthology.task.ansible.out: false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.408 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.409 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.411 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.412 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.520) 0:00:07.493 ******* 2020-11-20T11:23:33.468 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.469 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.471 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.472 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.474 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.474 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.475 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.476 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.477 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.478 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.480 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.482 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhoj 2020-11-20T11:23:33.484 INFO:teuthology.task.ansible.out:r", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.485 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.485 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c2 2020-11-20T11:23:33.487 INFO:teuthology.task.ansible.out:2fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.487 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.488 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.489 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.490 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.492 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.493 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:23:33.495 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:23:33.495 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.496 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.089) 0:00:07.583 ******* 2020-11-20T11:23:33.557 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.558 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.560 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.562 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.563 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.564 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.564 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.564 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@ 2020-11-20T11:23:33.566 INFO:teuthology.task.ansible.out:minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.566 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.567 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70 2020-11-20T11:23:33.568 INFO:teuthology.task.ansible.out:fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.569 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional 2020-11-20T11:23:33.570 INFO:teuthology.task.ansible.out:result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.572 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2020-11-20T11:23:33.573 INFO:teuthology.task.ansible.out:": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.069) 0:00:07.653 ******* 2020-11-20T11:23:33.625 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.627 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.628 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas 2020-11-20T11:23:33.630 INFO:teuthology.task.ansible.out:@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mdi 2020-11-20T11:23:33.631 INFO:teuthology.task.ansible.out:palma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c5 2020-11-20T11:23:33.633 INFO:teuthology.task.ansible.out:0647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.635 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 2020-11-20T11:23:33.638 INFO:teuthology.task.ansible.out:4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.647 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.648 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.650 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.650 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:23:33.651 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.651 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:23:33.651 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.652 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.677 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.680 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible 2020-11-20T11:23:33.682 INFO:teuthology.task.ansible.out:_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.095) 0:00:07.748 ******* 2020-11-20T11:23:33.745 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.030) 0:00:07.779 ******* 2020-11-20T11:23:33.751 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.769 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T11:23:33.771 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:23:33.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.058) 0:00:07.837 ******* 2020-11-20T11:23:33.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.032) 0:00:07.870 ******* 2020-11-20T11:23:33.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.032) 0:00:07.902 ******* 2020-11-20T11:23:33.873 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:23:33.875 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.912 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.044) 0:00:07.947 ******* 2020-11-20T11:23:33.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.036) 0:00:07.983 ******* 2020-11-20T11:23:33.954 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:23:33.956 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:33.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:33 +0000 (0:00:00.041) 0:00:08.024 ******* 2020-11-20T11:23:34.022 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.031) 0:00:08.056 ******* 2020-11-20T11:23:34.028 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:23:34.030 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.064 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.042) 0:00:08.099 ******* 2020-11-20T11:23:34.071 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.071 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.072 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.073 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.074 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.075 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.049) 0:00:08.149 ******* 2020-11-20T11:23:34.120 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.122 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.122 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T11:23:34.123 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:23:34.123 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.124 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.125 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.125 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.126 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, " 2020-11-20T11:23:34.127 INFO:teuthology.task.ansible.out:item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.048) 0:00:08.197 ******* 2020-11-20T11:23:34.169 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.170 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.171 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.172 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.172 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.172 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.173 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.173 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.174 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.175 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": 2020-11-20T11:23:34.177 INFO:teuthology.task.ansible.out:"jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.048) 0:00:08.246 ******* 2020-11-20T11:23:34.217 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.220 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.220 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.044) 0:00:08.291 ******* 2020-11-20T11:23:34.262 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.265 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.266 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.268 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", 2020-11-20T11:23:34.272 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.305 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.049) 0:00:08.340 ******* 2020-11-20T11:23:34.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.032) 0:00:08.373 ******* 2020-11-20T11:23:34.343 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:23:34.345 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.041) 0:00:08.414 ******* 2020-11-20T11:23:34.386 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:23:34.388 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.043) 0:00:08.458 ******* 2020-11-20T11:23:34.429 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:23:34.431 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.431 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.444 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.446 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi100.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.056) 0:00:08.514 ******* 2020-11-20T11:23:34.485 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.487 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.501 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.503 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.503 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.515 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.516 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.529 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.530 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.540 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.542 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.543 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.553 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.555 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.555 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.566 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.568 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.579 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.579 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.580 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.580 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.591 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.593 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.593 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.605 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.607 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.618 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.620 INFO:teuthology.task.ansible.out: skipping: [smithi105.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.631 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.633 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.635 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.635 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.641 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.648 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.651 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.661 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.663 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.664 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.664 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.665 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.665 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.676 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.678 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.692 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.694 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.731 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.251) 0:00:08.766 ******* 2020-11-20T11:23:34.738 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.739 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.740 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.740 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.741 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.741 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.742 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.745 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:34.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:34 +0000 (0:00:00.050) 0:00:08.816 ******* 2020-11-20T11:23:35.065 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:23:35.067 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:23:35.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.319) 0:00:09.135 ******* 2020-11-20T11:23:35.127 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:23:35.129 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => { "msg": "Host smithi067.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T11:23:35.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.060) 0:00:09.196 ******* 2020-11-20T11:23:35.201 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T11:23:35.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.073) 0:00:09.269 ******* 2020-11-20T11:23:35.242 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:23:35.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.045) 0:00:09.315 ******* 2020-11-20T11:23:35.286 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:23:35.288 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:23:35.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.041) 0:00:09.357 ******* 2020-11-20T11:23:35.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.032) 0:00:09.389 ******* 2020-11-20T11:23:35.361 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi100.front.sepia.ceph.com] => { "msg": "Host smithi100.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T11:23:35.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.041) 0:00:09.431 ******* 2020-11-20T11:23:35.402 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => { "msg": "Host smithi105.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T11:23:35.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.041) 0:00:09.472 ******* 2020-11-20T11:23:35.442 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:23:35.444 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T11:23:35.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.042) 0:00:09.515 ******* 2020-11-20T11:23:35.487 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T11:23:35.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.041) 0:00:09.557 ******* 2020-11-20T11:23:35.527 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:23:35.529 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:35.562 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.040) 0:00:09.597 ******* 2020-11-20T11:23:35.568 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:35.603 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.040) 0:00:09.637 ******* 2020-11-20T11:23:35.872 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:23:35.874 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.345684", "end": "2020-11-20 11:23:35.851952", "rc": 0, "start": "2020-11-20 11:23:35.506268", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:23:35.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.304) 0:00:09.942 ******* 2020-11-20T11:23:35.934 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:23:35.936 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:35.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:35 +0000 (0:00:00.065) 0:00:10.008 ******* 2020-11-20T11:23:36.011 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:23:36.012 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.050 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.077) 0:00:10.085 ******* 2020-11-20T11:23:36.078 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.060) 0:00:10.145 ******* 2020-11-20T11:23:36.117 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:23:36.119 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.337076", "end": "2020-11-20 11:23:36.068487", "rc": 0, "start": "2020-11-20 11:23:35.731411", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:23:36.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.040) 0:00:10.186 ******* 2020-11-20T11:23:36.156 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:23:36.157 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.039) 0:00:10.225 ******* 2020-11-20T11:23:36.196 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:23:36.198 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.363985", "end": "2020-11-20 11:23:36.136282", "rc": 0, "start": "2020-11-20 11:23:35.772297", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.232 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.267 ******* 2020-11-20T11:23:36.263 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.298 ******* 2020-11-20T11:23:36.268 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:23:36.270 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.040) 0:00:10.339 ******* 2020-11-20T11:23:36.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.369 ******* 2020-11-20T11:23:36.339 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:23:36.341 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.376 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.411 ******* 2020-11-20T11:23:36.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.442 ******* 2020-11-20T11:23:36.412 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:23:36.414 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi067.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:36.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.484 ******* 2020-11-20T11:23:36.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.514 ******* 2020-11-20T11:23:36.485 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:23:36.487 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.042) 0:00:10.557 ******* 2020-11-20T11:23:36.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.031) 0:00:10.588 ******* 2020-11-20T11:23:36.559 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:23:36.561 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.629 ******* 2020-11-20T11:23:36.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.660 ******* 2020-11-20T11:23:36.631 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:23:36.633 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:36.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.701 ******* 2020-11-20T11:23:36.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.030) 0:00:10.732 ******* 2020-11-20T11:23:36.703 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:23:36.704 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.046) 0:00:10.778 ******* 2020-11-20T11:23:36.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.034) 0:00:10.812 ******* 2020-11-20T11:23:36.784 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:23:36.786 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:36.820 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.043) 0:00:10.855 ******* 2020-11-20T11:23:36.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.031) 0:00:10.887 ******* 2020-11-20T11:23:36.858 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:23:36.859 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.894 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:10.929 ******* 2020-11-20T11:23:36.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.031) 0:00:10.960 ******* 2020-11-20T11:23:36.931 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:23:36.933 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:36.967 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.041) 0:00:11.002 ******* 2020-11-20T11:23:36.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:36 +0000 (0:00:00.031) 0:00:11.034 ******* 2020-11-20T11:23:37.004 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:23:37.006 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.042 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.043) 0:00:11.077 ******* 2020-11-20T11:23:37.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.033) 0:00:11.111 ******* 2020-11-20T11:23:37.083 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:23:37.084 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.043) 0:00:11.155 ******* 2020-11-20T11:23:37.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.034) 0:00:11.189 ******* 2020-11-20T11:23:37.160 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T11:23:37.162 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:37.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.046) 0:00:11.235 ******* 2020-11-20T11:23:37.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.036) 0:00:11.271 ******* 2020-11-20T11:23:37.243 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:23:37.244 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.040) 0:00:11.312 ******* 2020-11-20T11:23:37.308 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.343 ******* 2020-11-20T11:23:37.314 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:23:37.315 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.316 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:11.385 ******* 2020-11-20T11:23:37.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.029) 0:00:11.414 ******* 2020-11-20T11:23:37.386 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.388 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.420 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.040) 0:00:11.455 ******* 2020-11-20T11:23:37.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.038) 0:00:11.494 ******* 2020-11-20T11:23:37.465 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:23:37.467 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.500 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:11.535 ******* 2020-11-20T11:23:37.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.566 ******* 2020-11-20T11:23:37.536 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:23:37.538 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.570 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.039) 0:00:11.605 ******* 2020-11-20T11:23:37.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.029) 0:00:11.635 ******* 2020-11-20T11:23:37.605 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:23:37.606 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.040) 0:00:11.676 ******* 2020-11-20T11:23:37.672 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.707 ******* 2020-11-20T11:23:37.678 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:23:37.680 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:37.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:11.748 ******* 2020-11-20T11:23:37.744 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.779 ******* 2020-11-20T11:23:37.749 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:23:37.751 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.039) 0:00:11.819 ******* 2020-11-20T11:23:37.815 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.850 ******* 2020-11-20T11:23:37.820 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:23:37.822 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:11.891 ******* 2020-11-20T11:23:37.887 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.030) 0:00:11.922 ******* 2020-11-20T11:23:37.893 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:23:37.894 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:37.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:11.963 ******* 2020-11-20T11:23:37.935 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:23:37.936 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:37.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:37 +0000 (0:00:00.041) 0:00:12.005 ******* 2020-11-20T11:23:38.083 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:23:38 +0000 (0:00:00.044) 0:00:12.050 ******* TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:23:38 +0000 (0:00:00.040) 0:00:12.091 ******* TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.096 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.040) 0:00:12.131 ******* 2020-11-20T11:23:38.102 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:23:38.104 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [common : List CDN releases available to system] ************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.045) 0:00:12.176 ******* 2020-11-20T11:23:38.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.031) 0:00:12.208 ******* 2020-11-20T11:23:38.179 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:23:38.181 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.047) 0:00:12.256 ******* 2020-11-20T11:23:38.227 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:23:38.230 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.042) 0:00:12.298 ******* 2020-11-20T11:23:38.270 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:23:38.278 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:38.306 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.042) 0:00:12.341 ******* 2020-11-20T11:23:38.313 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.349 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.042) 0:00:12.384 ******* 2020-11-20T11:23:38.355 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:23:38.357 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.042) 0:00:12.426 ******* 2020-11-20T11:23:38.397 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:23:38.399 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:38.435 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.043) 0:00:12.469 ******* 2020-11-20T11:23:38.442 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:23:38.444 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.049) 0:00:12.519 ******* 2020-11-20T11:23:38.497 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:23:38.500 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.053) 0:00:12.573 ******* 2020-11-20T11:23:38.544 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:23:38.546 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.040) 0:00:12.614 ******* 2020-11-20T11:23:38.587 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:23:38.589 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.046) 0:00:12.660 ******* 2020-11-20T11:23:38.634 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:23:38.635 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.046) 0:00:12.706 ******* 2020-11-20T11:23:38.677 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:23:38.679 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.043) 0:00:12.750 ******* 2020-11-20T11:23:38.721 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:23:38.722 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.723 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:23:38.724 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:23:38.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.045) 0:00:12.795 ******* 2020-11-20T11:23:38.766 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:23:38.767 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.043) 0:00:12.838 ******* 2020-11-20T11:23:38.810 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:23:38.811 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.041) 0:00:12.880 ******* 2020-11-20T11:23:38.851 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:23:38.853 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.041) 0:00:12.921 ******* 2020-11-20T11:23:38.892 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T11:23:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:38.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.040) 0:00:12.962 ******* 2020-11-20T11:23:38.935 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:23:38.936 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:38.969 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:38 +0000 (0:00:00.041) 0:00:13.004 ******* 2020-11-20T11:23:38.975 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:23:38.977 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:39.014 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.044) 0:00:13.049 ******* 2020-11-20T11:23:39.020 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T11:23:39.022 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:23:39.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.041) 0:00:13.090 ******* 2020-11-20T11:23:39.062 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:39.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.042) 0:00:13.132 ******* 2020-11-20T11:23:39.104 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:23:39.106 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:39.139 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.041) 0:00:13.174 ******* 2020-11-20T11:23:39.166 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:23:39.169 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:23:39.170 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:39.203 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.063) 0:00:13.238 ******* 2020-11-20T11:23:39.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.033) 0:00:13.272 ******* 2020-11-20T11:23:39.306 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:23:39.308 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:23:39.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.105) 0:00:13.377 ******* 2020-11-20T11:23:39.443 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:23:39.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:39 +0000 (0:00:00.136) 0:00:13.513 ******* 2020-11-20T11:23:39.716 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:23:39.718 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:23:39.848 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:23:39.851 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:23:40.024 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:23:40.229 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi067.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:23:40.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.785) 0:00:14.299 ******* 2020-11-20T11:23:40.292 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.060) 0:00:14.359 ******* 2020-11-20T11:23:40.352 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:23:40.353 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:23:40.355 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.063) 0:00:14.423 ******* 2020-11-20T11:23:40.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.031) 0:00:14.454 ******* 2020-11-20T11:23:40.426 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:23:40.430 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.461 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.041) 0:00:14.496 ******* 2020-11-20T11:23:40.489 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:23:40.491 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.075) 0:00:14.572 ******* 2020-11-20T11:23:40.554 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:23:40.556 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:23:40.593 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.055) 0:00:14.627 ******* 2020-11-20T11:23:40.600 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.651 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.058) 0:00:14.686 ******* 2020-11-20T11:23:40.680 INFO:teuthology.task.ansible.out: 2020-11-20T11:23:40.682 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone] *********************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.063) 0:00:14.749 ******* 2020-11-20T11:23:40.742 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.063) 0:00:14.813 ******* 2020-11-20T11:23:40.805 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.062) 0:00:14.875 ******* 2020-11-20T11:23:40.867 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:23:40.868 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:40.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:40 +0000 (0:00:00.061) 0:00:14.936 ******* 2020-11-20T11:23:40.939 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:23:40.941 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:23:41.111 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:23:41.400 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:23:41.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.546) 0:00:15.483 ******* 2020-11-20T11:23:41.488 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:23:41.490 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.073) 0:00:15.556 ******* 2020-11-20T11:23:41.528 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:23:41.530 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.410891", "end": "2020-11-20 11:23:41.500364", "rc": 0, "start": "2020-11-20 11:23:41.089473", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:23:41.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.042) 0:00:15.599 ******* 2020-11-20T11:23:41.571 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:23:41.573 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi105.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:23:41.610 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.045) 0:00:15.645 ******* 2020-11-20T11:23:41.642 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.031) 0:00:15.677 ******* 2020-11-20T11:23:41.648 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:23:41.650 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.042) 0:00:15.719 ******* 2020-11-20T11:23:41.690 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:23:41.692 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.042) 0:00:15.762 ******* 2020-11-20T11:23:41.733 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:23:41.735 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.044) 0:00:15.806 ******* 2020-11-20T11:23:41.778 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:23:41.780 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.815 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.043) 0:00:15.850 ******* 2020-11-20T11:23:41.821 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:23:41.823 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.877 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.062) 0:00:15.912 ******* 2020-11-20T11:23:41.884 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.918 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.040) 0:00:15.953 ******* 2020-11-20T11:23:41.924 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:23:41.926 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.040) 0:00:15.994 ******* 2020-11-20T11:23:41.965 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:23:41.967 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:41.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:41 +0000 (0:00:00.040) 0:00:16.034 ******* 2020-11-20T11:23:42.005 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:23:42.007 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.040) 0:00:16.075 ******* 2020-11-20T11:23:42.048 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:23:42.050 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.041) 0:00:16.116 ******* 2020-11-20T11:23:42.088 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:23:42.089 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.123 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.041) 0:00:16.158 ******* 2020-11-20T11:23:42.130 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:23:42.131 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.040) 0:00:16.198 ******* 2020-11-20T11:23:42.169 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:23:42.171 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.040) 0:00:16.239 ******* 2020-11-20T11:23:42.210 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:23:42.212 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.042) 0:00:16.281 ******* 2020-11-20T11:23:42.274 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:23:42.276 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.061) 0:00:16.342 ******* 2020-11-20T11:23:42.334 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:23:42.336 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.060) 0:00:16.403 ******* 2020-11-20T11:23:42.524 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.127888", "end": "2020-11-20 11:23:42.500371", "rc": 0, "start": "2020-11-20 11:23:42.372483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:23:42.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.190) 0:00:16.594 ******* 2020-11-20T11:23:42.861 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:23:42.863 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:23:42.895 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.336) 0:00:16.930 ******* 2020-11-20T11:23:42.923 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:42.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:42 +0000 (0:00:00.061) 0:00:16.991 ******* 2020-11-20T11:23:42.983 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:23:42.985 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.060) 0:00:17.051 ******* 2020-11-20T11:23:43.043 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:23:43.045 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.064) 0:00:17.116 ******* 2020-11-20T11:23:43.119 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:23:43.121 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.071) 0:00:17.188 ******* 2020-11-20T11:23:43.494 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:23:43.495 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:23:43.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.376) 0:00:17.564 ******* 2020-11-20T11:23:43.536 INFO:teuthology.task.ansible.out: 2020-11-20T11:23:43.537 INFO:teuthology.task.ansible.out:TASK [common : Set the hardware clock] ***************************************** changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.962597", "end": "2020-11-20 11:23:43.500339", "rc": 0, "start": "2020-11-20 11:23:42.537742", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:23:43.570 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.041) 0:00:17.605 ******* 2020-11-20T11:23:43.577 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:23:43.578 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.042) 0:00:17.647 ******* 2020-11-20T11:23:43.630 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:23:43.631 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:23:43.664 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.051) 0:00:17.699 ******* 2020-11-20T11:23:43.670 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:23:43.672 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.042) 0:00:17.741 ******* 2020-11-20T11:23:43.734 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:23:43.735 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.060) 0:00:17.802 ******* 2020-11-20T11:23:43.794 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:23:43.796 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:43.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:43 +0000 (0:00:00.060) 0:00:17.862 ******* 2020-11-20T11:23:44.275 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:23:44.360 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} Friday 20 November 2020 11:23:44 +0000 (0:00:00.481) 0:00:18.343 ******* 2020-11-20T11:23:44.494 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:23:44.495 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:23:44.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:44 +0000 (0:00:00.220) 0:00:18.563 ******* 2020-11-20T11:23:44.556 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:23:44.558 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:44.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:44 +0000 (0:00:00.061) 0:00:18.625 ******* 2020-11-20T11:23:44.618 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:23:44.620 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:44.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:44 +0000 (0:00:00.060) 0:00:18.685 ******* 2020-11-20T11:23:44.688 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:23:44.690 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:44.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:44 +0000 (0:00:00.075) 0:00:18.761 ******* 2020-11-20T11:23:44.755 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:44.786 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:44 +0000 (0:00:00.060) 0:00:18.821 ******* 2020-11-20T11:23:45.235 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:23:45.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:45 +0000 (0:00:00.481) 0:00:19.302 ******* 2020-11-20T11:23:47.495 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:23:47.497 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T11:23:47.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:47 +0000 (0:00:02.263) 0:00:21.566 ******* 2020-11-20T11:23:47.657 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T11:23:47.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:47 +0000 (0:00:00.167) 0:00:21.733 ******* 2020-11-20T11:23:48.050 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi067.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:23:48.210 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:23:48.358 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:23:48.360 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T11:23:48.395 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:48 +0000 (0:00:00.696) 0:00:22.430 ******* 2020-11-20T11:23:48.538 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:23:48.541 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:23:48.697 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:23:48.921 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:23:48.996 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:23:49.032 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:49 +0000 (0:00:00.636) 0:00:23.067 ******* 2020-11-20T11:23:49.155 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:23:49.193 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:49 +0000 (0:00:00.161) 0:00:23.228 ******* 2020-11-20T11:23:49.231 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:23:49.233 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:23:49.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:49 +0000 (0:00:00.075) 0:00:23.304 ******* 2020-11-20T11:23:49.271 INFO:teuthology.task.ansible.out: 2020-11-20T11:23:49.385 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:23:49.430 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:49 +0000 (0:00:00.160) 0:00:23.465 ******* 2020-11-20T11:23:49.437 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:23:49.438 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:23:49.784 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:23:49.786 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:23:49.933 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi105.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:23:49.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:49 +0000 (0:00:00.538) 0:00:24.003 ******* 2020-11-20T11:23:49.985 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:23:49.987 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:23:50.165 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:23:50.167 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:23:50.199 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:50 +0000 (0:00:00.229) 0:00:24.233 ******* 2020-11-20T11:23:50.237 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:23:50.239 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:23:50.440 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:23:50.699 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:23:50.729 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:23:50.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:50 +0000 (0:00:00.565) 0:00:24.799 ******* 2020-11-20T11:23:50.791 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:23:50.793 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:50.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:50 +0000 (0:00:00.065) 0:00:24.865 ******* 2020-11-20T11:23:50.870 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:23:50.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:50 +0000 (0:00:00.073) 0:00:24.938 ******* 2020-11-20T11:23:50.910 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:23:50.912 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:23:50.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:50 +0000 (0:00:00.048) 0:00:24.987 ******* 2020-11-20T11:23:50.979 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.061) 0:00:25.048 ******* 2020-11-20T11:23:51.051 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:23:51.053 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:23:51.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.074) 0:00:25.122 ******* 2020-11-20T11:23:51.115 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:23:51.117 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:23:51.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.072) 0:00:25.195 ******* 2020-11-20T11:23:51.169 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi105.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:23:51.202 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.214 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.225 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.236 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.113) 0:00:25.308 ******* 2020-11-20T11:23:51.303 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:23:51.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.075) 0:00:25.384 ******* 2020-11-20T11:23:51.396 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:23:51.397 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.409 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.420 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.431 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.116) 0:00:25.501 ******* 2020-11-20T11:23:51.621 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:23:51.623 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:23:51.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.195) 0:00:25.696 ******* 2020-11-20T11:23:51.688 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:23:51.690 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:51.722 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.060) 0:00:25.757 ******* 2020-11-20T11:23:51.759 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:23:51.761 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:23:51.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:51 +0000 (0:00:00.070) 0:00:25.827 ******* 2020-11-20T11:23:52.017 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:23:52.019 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:23:52.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.277) 0:00:26.104 ******* 2020-11-20T11:23:52.106 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:23:52.108 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.118 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.129 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.140 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.105) 0:00:26.209 ******* 2020-11-20T11:23:52.300 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:23:52.337 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.161) 0:00:26.371 ******* 2020-11-20T11:23:52.366 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.060) 0:00:26.432 ******* 2020-11-20T11:23:52.415 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:23:52.417 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:23:52.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.059) 0:00:26.491 ******* 2020-11-20T11:23:52.485 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:23:52.486 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:52.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.062) 0:00:26.553 ******* 2020-11-20T11:23:52.906 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:23:52.908 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:23:52.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:52 +0000 (0:00:00.421) 0:00:26.975 ******* 2020-11-20T11:23:53.038 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:23:53.077 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.134) 0:00:27.110 ******* 2020-11-20T11:23:53.115 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:23:53.117 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:23:53.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.078) 0:00:27.188 ******* 2020-11-20T11:23:53.182 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:23:53.183 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:53.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.062) 0:00:27.251 ******* 2020-11-20T11:23:53.428 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:23:53.430 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:23:53.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.246) 0:00:27.498 ******* 2020-11-20T11:23:53.490 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:23:53.492 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:53.501 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:53.535 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.072) 0:00:27.570 ******* 2020-11-20T11:23:53.551 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:23:53.553 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:23:53.587 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.051) 0:00:27.622 ******* 2020-11-20T11:23:53.667 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:23:53.669 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:23:53.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.128) 0:00:27.750 ******* 2020-11-20T11:23:53.745 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:23:53.747 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:23:53.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.173) 0:00:27.923 ******* 2020-11-20T11:23:53.895 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:23:53.897 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:53.932 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:53 +0000 (0:00:00.044) 0:00:27.967 ******* 2020-11-20T11:23:54.129 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:23:54.130 INFO:teuthology.task.ansible.out:fatal: [smithi067.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:23:54.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.230) 0:00:28.198 ******* 2020-11-20T11:23:54.170 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:23:54.172 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:23:54.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.042) 0:00:28.241 ******* 2020-11-20T11:23:54.212 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:23:54.213 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:54.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.041) 0:00:28.283 ******* 2020-11-20T11:23:54.263 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:23:54.265 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:23:54.300 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.052) 0:00:28.335 ******* 2020-11-20T11:23:54.338 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi105.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:54.348 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:23:54.383 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.083) 0:00:28.418 ******* 2020-11-20T11:23:54.420 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:23:54.422 INFO:teuthology.task.ansible.out:fatal: [smithi100.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:23:54.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.075) 0:00:28.493 ******* 2020-11-20T11:23:54.485 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:23:54.487 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:54.519 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.060) 0:00:28.554 ******* 2020-11-20T11:23:54.587 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:23:54.589 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:23:54.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.103) 0:00:28.657 ******* 2020-11-20T11:23:54.722 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:23:54.724 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:23:54.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.134) 0:00:28.792 ******* 2020-11-20T11:23:54.841 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:23:54.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.121) 0:00:28.913 ******* 2020-11-20T11:23:54.906 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:23:54.908 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:23:54.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:54 +0000 (0:00:00.061) 0:00:28.975 ******* 2020-11-20T11:23:54.978 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:23:54.979 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:23:55.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:55 +0000 (0:00:00.073) 0:00:29.048 ******* 2020-11-20T11:23:55.350 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:23:55.351 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ActiveEnterTimestampMonotonic": "15630758", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target tmp.mount nss-lookup.target basic.target local-fs.target system.slice sysinit.target network.target var-run.mount -.mount systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:22:00 UTC", "AssertTimestampMonotonic": "15630013", "Before": "getty@tty1.service shutdown.target multi-user.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ConditionTimestampMonotonic": "15630013", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-11-20T11:23:55.353 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2498", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ExecMainStartTimestampMonotonic": "15630731", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:22:00 UTC", "InactiveExitTimestampMonotonic": "15630758", "InvocationID": "5b78e82aa9934b86b67899677cedf481", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitD 2020-11-20T11:23:55.358 INFO:teuthology.task.ansible.out:ATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2498", "MemoryAccounting": "yes", "MemoryCurrent": "1208320", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode 2020-11-20T11:23:55.360 INFO:teuthology.task.ansible.out:": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:00 UTC", "StateChangeTimestampMonotonic": "15630758", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:00 UTC", "WatchdogTimestampMonotonic": "15630757", "WatchdogUSec": "0"}} 2020-11-20T11:23:55.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:55 +0000 (0:00:00.372) 0:00:29.421 ******* 2020-11-20T11:23:55.394 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:01 UTC", "ActiveEnterTimestampMonotonic": "15191962", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount systemd-journald.socket nss-lookup.target systemd-tmpfiles-setup.service tmp.mount -.mount sysinit.target local-fs.target basic.target time-sync.target system.slice network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:22:01 UTC", "AssertTimestampMonotonic": "15190982", "Before": "getty@tty1.service shutdown.target xdm.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:22:01 UTC", "ConditionTimestampMonotonic": "15190982", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-11-20T11:23:55.396 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2489", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:01 UTC", "ExecMainStartTimestampMonotonic": "15191926", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:22:01 UTC", "InactiveExitTimestampMonotonic": "15191962", "InvocationID": "6631d3a40bd241c8813d002c80fc951c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitD 2020-11-20T11:23:55.397 INFO:teuthology.task.ansible.out:ATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2489", "MemoryAccounting": "yes", "MemoryCurrent": "1155072", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode 2020-11-20T11:23:55.399 INFO:teuthology.task.ansible.out:": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:01 UTC", "StateChangeTimestampMonotonic": "15191962", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:01 UTC", "WatchdogTimestampMonotonic": "15191961", "WatchdogUSec": "0"}} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:23:55.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:55 +0000 (0:00:00.044) 0:00:29.466 ******* 2020-11-20T11:23:55.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:55 +0000 (0:00:00.031) 0:00:29.498 ******* 2020-11-20T11:23:55.575 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:23:55.914 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001727", "end": "2020-11-20 11:23:55.553664", "rc": 0, "start": "2020-11-20 11:23:55.551937", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} Friday 20 November 2020 11:23:55 +0000 (0:00:00.147) 0:00:29.646 ******* changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001701", "end": "2020-11-20 11:23:55.626925", "rc": 0, "start": "2020-11-20 11:23:55.625224", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} Friday 20 November 2020 11:23:55 +0000 (0:00:00.072) 0:00:29.718 ******* TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:10 UTC", "ActiveEnterTimestampMonotonic": "14830338", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target systemd-journald.socket sysinit.target basic.target systemd-tmpfiles-setup.service tmp.mount network.target system.slice nss-lookup.target -.mount time-sync.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:22:10 UTC", "AssertTimestampMonotonic": "14829438", "Before": "shutdown.target getty@tty1.service multi-user.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "c 2020-11-20T11:23:55.916 INFO:teuthology.task.ansible.out:ap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:22:10 UTC", "ConditionTimestampMonotonic": "14829438", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2495", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:10 UTC", "ExecMainStartTimestampMonotonic": "14830303", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[ 2020-11-20T11:23:55.918 INFO:teuthology.task.ansible.out:not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:22:10 UTC", "InactiveExitTimestampMonotonic": "14830338", "InvocationID": "3a85589471b847adbfee448a79e71464", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2495", "MemoryAccounting": "yes", "MemoryCurrent": "1220608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonB 2020-11-20T11:23:55.920 INFO:teuthology.task.ansible.out:locking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:10 UTC", "StateChangeTimestampMonotonic": "14830338", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabl 2020-11-20T11:23:55.922 INFO:teuthology.task.ansible.out:ed", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:10 UTC", "WatchdogTimestampMonotonic": "14830337", "WatchdogUSec": "0"}} Friday 20 November 2020 11:23:55 +0000 (0:00:00.140) 0:00:29.859 ******* 2020-11-20T11:23:56.021 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001737", "end": "2020-11-20 11:23:55.991932", "rc": 0, "start": "2020-11-20 11:23:55.990195", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:23:56.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:56 +0000 (0:00:00.231) 0:00:30.090 ******* 2020-11-20T11:23:56.536 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:23:56.537 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:23:56.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:56 +0000 (0:00:00.515) 0:00:30.606 ******* 2020-11-20T11:23:56.671 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:23:56.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:56 +0000 (0:00:00.134) 0:00:30.740 ******* 2020-11-20T11:23:56.966 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:23:57.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:57 +0000 (0:00:00.295) 0:00:31.036 ******* 2020-11-20T11:23:57.491 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:23:57.493 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:23:57.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:57 +0000 (0:00:00.523) 0:00:31.560 ******* 2020-11-20T11:23:57.683 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:23:57.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:57 +0000 (0:00:00.201) 0:00:31.762 ******* 2020-11-20T11:23:58.062 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:23:58.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:58 +0000 (0:00:00.369) 0:00:32.131 ******* 2020-11-20T11:23:58.795 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:23:58.797 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:23:58.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:58 +0000 (0:00:00.732) 0:00:32.864 ******* 2020-11-20T11:23:58.846 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:23:58.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:58 +0000 (0:00:00.051) 0:00:32.916 ******* 2020-11-20T11:23:59.265 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:23:59.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:23:59 +0000 (0:00:00.418) 0:00:33.334 ******* 2020-11-20T11:24:15.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:24:15.324 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.248863", "end": "2020-11-20 11:24:15.299666", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:59.050803", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:24:15.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:15 +0000 (0:00:16.058) 0:00:49.393 ******* 2020-11-20T11:24:15.757 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.270538", "end": "2020-11-20 11:24:15.736102", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:59.465564", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:24:15.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:15 +0000 (0:00:00.444) 0:00:49.837 ******* 2020-11-20T11:24:15.818 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:24:15.820 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:24:15.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:15 +0000 (0:00:00.052) 0:00:49.889 ******* 2020-11-20T11:24:15.968 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.925218", "end": "2020-11-20 11:24:15.936783", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:23:59.011565", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:24:16.004 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:15 +0000 (0:00:00.149) 0:00:50.039 ******* 2020-11-20T11:24:16.054 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:24:16.055 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016129", "end": "2020-11-20 11:24:16.035327", "rc": 0, "start": "2020-11-20 11:24:16.019198", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:16.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.089) 0:00:50.128 ******* 2020-11-20T11:24:16.248 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:24:16.250 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:24:16.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.190) 0:00:50.319 ******* 2020-11-20T11:24:16.312 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.020258", "end": "2020-11-20 11:24:16.284828", "rc": 0, "start": "2020-11-20 11:24:16.264570", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:16.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.064) 0:00:50.383 ******* 2020-11-20T11:24:16.483 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:24:16.485 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:24:16.519 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.171) 0:00:50.554 ******* 2020-11-20T11:24:16.526 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:24:16.528 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.021738", "end": "2020-11-20 11:24:16.481144", "rc": 0, "start": "2020-11-20 11:24:16.459406", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:16.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.043) 0:00:50.598 ******* 2020-11-20T11:24:16.728 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011753", "end": "2020-11-20 11:24:16.710582", "rc": 0, "start": "2020-11-20 11:24:16.698829", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:16.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.201) 0:00:50.800 ******* 2020-11-20T11:24:16.772 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:24:16.774 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008770", "end": "2020-11-20 11:24:16.746212", "rc": 0, "start": "2020-11-20 11:24:16.737442", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:16.808 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:16 +0000 (0:00:00.042) 0:00:50.843 ******* 2020-11-20T11:24:16.973 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008513", "end": "2020-11-20 11:24:16.952067", "rc": 0, "start": "2020-11-20 11:24:16.943554", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:17.010 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:17 +0000 (0:00:00.202) 0:00:51.045 ******* 2020-11-20T11:24:32.731 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.183428", "end": "2020-11-20 11:24:32.708215", "rc": 0, "start": "2020-11-20 11:24:16.524787", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:32.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:32 +0000 (0:00:15.754) 0:01:06.800 ******* 2020-11-20T11:24:32.961 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:24:32.963 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:24:32.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:32 +0000 (0:00:00.233) 0:01:07.034 ******* 2020-11-20T11:24:33.026 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:24:33.027 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:33.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.074) 0:01:07.108 ******* 2020-11-20T11:24:33.114 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:33.116 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:24:33.152 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.078) 0:01:07.186 ******* 2020-11-20T11:24:33.179 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:24:33.180 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:33.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.064) 0:01:07.251 ******* 2020-11-20T11:24:33.243 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:33.245 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:33.278 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.062) 0:01:07.313 ******* 2020-11-20T11:24:33.337 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:24:33.338 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:24:33.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.096) 0:01:07.409 ******* 2020-11-20T11:24:33.583 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:24:33.585 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:24:33.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.245) 0:01:07.655 ******* 2020-11-20T11:24:33.742 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:24:33.744 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.728183", "end": "2020-11-20 11:24:33.703559", "rc": 0, "start": "2020-11-20 11:24:16.975376", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:33.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:33 +0000 (0:00:00.158) 0:01:07.813 ******* 2020-11-20T11:24:33.976 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:24:33.978 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:24:34.011 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.232) 0:01:08.046 ******* 2020-11-20T11:24:34.038 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:24:34.040 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.062) 0:01:08.108 ******* 2020-11-20T11:24:34.080 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:24:34.082 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.851252", "end": "2020-11-20 11:24:34.042675", "rc": 0, "start": "2020-11-20 11:24:17.191423", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:34.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.150 ******* 2020-11-20T11:24:34.129 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:34.131 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:24:34.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.048) 0:01:08.199 ******* 2020-11-20T11:24:34.170 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:24:34.172 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871473.647411-170354181752368/source", "state": "file", "uid": 0} 2020-11-20T11:24:34.207 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.043) 0:01:08.242 ******* 2020-11-20T11:24:34.214 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:24:34.216 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.283 ******* 2020-11-20T11:24:34.255 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:24:34.257 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:24:34.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.325 ******* 2020-11-20T11:24:34.297 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:34.299 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.042) 0:01:08.367 ******* 2020-11-20T11:24:34.338 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:24:34.339 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:24:34.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.409 ******* 2020-11-20T11:24:34.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.031) 0:01:08.440 ******* 2020-11-20T11:24:34.411 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:24:34.413 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Check for podman] *********************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.042) 0:01:08.483 ******* 2020-11-20T11:24:34.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.031) 0:01:08.514 ******* 2020-11-20T11:24:34.485 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:24:34.486 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T11:24:34.488 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:34.489 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:24:34.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.042) 0:01:08.557 ******* 2020-11-20T11:24:34.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.033) 0:01:08.591 ******* 2020-11-20T11:24:34.562 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:24:34.564 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.632 ******* 2020-11-20T11:24:34.604 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:24:34.605 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:24:34.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.041) 0:01:08.673 ******* 2020-11-20T11:24:34.646 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:24:34.648 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:34.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.042) 0:01:08.716 ******* 2020-11-20T11:24:34.698 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:24:34.700 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:24:34.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.053) 0:01:08.769 ******* 2020-11-20T11:24:34.740 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:24:34.742 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:24:34.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.044) 0:01:08.813 ******* 2020-11-20T11:24:34.837 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:24:34.839 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:24:34.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:34 +0000 (0:00:00.095) 0:01:08.908 ******* 2020-11-20T11:24:35.013 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:24:35.014 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:24:35.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.172) 0:01:09.081 ******* 2020-11-20T11:24:35.074 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:24:35.076 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:24:35.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.062) 0:01:09.144 ******* 2020-11-20T11:24:35.136 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:24:35.137 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:35.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.060) 0:01:09.205 ******* 2020-11-20T11:24:35.198 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:24:35.200 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:35.232 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.061) 0:01:09.267 ******* 2020-11-20T11:24:35.238 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:24:35.240 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871474.7598739-35742746873093/source", "state": "file", "uid": 0} 2020-11-20T11:24:35.275 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.043) 0:01:09.310 ******* 2020-11-20T11:24:35.302 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:24:35.304 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:24:35.336 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.060) 0:01:09.371 ******* 2020-11-20T11:24:35.374 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:24:35.376 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:24:35.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.080) 0:01:09.451 ******* 2020-11-20T11:24:35.436 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:24:35.437 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:24:35.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.063) 0:01:09.515 ******* 2020-11-20T11:24:35.486 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:24:35.487 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T11:24:35.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.049) 0:01:09.564 ******* 2020-11-20T11:24:35.566 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:24:35.567 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:24:35.568 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605871475.0745337-44618449210702/source", "state": "file", "uid": 0} 2020-11-20T11:24:35.603 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.073) 0:01:09.638 ******* 2020-11-20T11:24:35.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.031) 0:01:09.670 ******* 2020-11-20T11:24:35.640 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:24:35.642 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:24:35.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.045) 0:01:09.715 ******* 2020-11-20T11:24:35.718 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:24:35.720 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:24:35.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.072) 0:01:09.788 ******* 2020-11-20T11:24:35.790 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:24:35.792 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T11:24:35.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.074) 0:01:09.862 ******* 2020-11-20T11:24:35.833 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:24:35.835 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:24:35.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.064) 0:01:09.927 ******* 2020-11-20T11:24:35.899 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:24:35.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:35 +0000 (0:00:00.061) 0:01:09.988 ******* 2020-11-20T11:24:36.033 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:24:36.035 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:24:36.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.116) 0:01:10.104 ******* 2020-11-20T11:24:36.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:24:36.100 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi100"}, "changed": false} 2020-11-20T11:24:36.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.063) 0:01:10.168 ******* 2020-11-20T11:24:36.161 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:24:36.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.066) 0:01:10.234 ******* 2020-11-20T11:24:36.208 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:24:36.209 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:24:36.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.050) 0:01:10.285 ******* 2020-11-20T11:24:36.257 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:24:36.258 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:36.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.044) 0:01:10.330 ******* 2020-11-20T11:24:36.325 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:24:36.327 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:36.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.063) 0:01:10.394 ******* 2020-11-20T11:24:36.452 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:24:36.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.130) 0:01:10.524 ******* 2020-11-20T11:24:36.517 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:24:36.519 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:36.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.061) 0:01:10.586 ******* 2020-11-20T11:24:36.578 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:24:36.579 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:36.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.061) 0:01:10.647 ******* 2020-11-20T11:24:36.643 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.030) 0:01:10.678 ******* 2020-11-20T11:24:36.827 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:24:36.829 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:24:36.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:36 +0000 (0:00:00.221) 0:01:10.899 ******* 2020-11-20T11:24:37.116 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:24:37.118 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi100", "ansible_hostname": "smithi100", "ansible_nodename": "smithi100"}, "changed": false, "name": "smithi100"} 2020-11-20T11:24:37.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.286) 0:01:11.186 ******* 2020-11-20T11:24:37.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:24:37.172 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:24:37.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.053) 0:01:11.240 ******* 2020-11-20T11:24:37.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:24:37.244 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi105"}, "changed": false} 2020-11-20T11:24:37.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.076) 0:01:11.316 ******* 2020-11-20T11:24:37.426 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:24:37.460 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.177) 0:01:11.494 ******* 2020-11-20T11:24:37.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:24:37.499 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi067"}, "changed": false} 2020-11-20T11:24:37.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.071) 0:01:11.566 ******* 2020-11-20T11:24:37.614 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:24:37.616 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:24:37.651 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.120) 0:01:11.686 ******* 2020-11-20T11:24:37.838 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:24:37.840 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi105", "ansible_hostname": "smithi105", "ansible_nodename": "smithi105"}, "changed": false, "name": "smithi105"} 2020-11-20T11:24:37.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:37 +0000 (0:00:00.222) 0:01:11.908 ******* 2020-11-20T11:24:38.155 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi067", "ansible_hostname": "smithi067", "ansible_nodename": "smithi067"}, "changed": false, "name": "smithi067"} 2020-11-20T11:24:38.191 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.317) 0:01:12.226 ******* 2020-11-20T11:24:38.199 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:24:38.235 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.044) 0:01:12.270 ******* 2020-11-20T11:24:38.368 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:24:38.370 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:24:38.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.174) 0:01:12.445 ******* 2020-11-20T11:24:38.672 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:24:38.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.315) 0:01:12.760 ******* 2020-11-20T11:24:38.841 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:24:38.843 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:24:38.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.153) 0:01:12.914 ******* 2020-11-20T11:24:38.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:24:38.887 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:24:38.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:38 +0000 (0:00:00.044) 0:01:12.958 ******* 2020-11-20T11:24:39.217 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:24:39.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.343) 0:01:13.301 ******* 2020-11-20T11:24:39.393 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:24:39.396 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:24:39.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.162) 0:01:13.464 ******* 2020-11-20T11:24:39.532 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:24:39.534 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:24:39.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.138) 0:01:13.602 ******* 2020-11-20T11:24:39.643 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:24:39.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.112) 0:01:13.714 ******* 2020-11-20T11:24:39.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:24:39.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.246) 0:01:13.960 ******* 2020-11-20T11:24:39.964 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:24:39.966 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:24:40.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:39 +0000 (0:00:00.073) 0:01:14.034 ******* 2020-11-20T11:24:40.059 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:24:40.061 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:24:40.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.095) 0:01:14.130 ******* 2020-11-20T11:24:40.144 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi100.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:24:40.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.086) 0:01:14.217 ******* 2020-11-20T11:24:40.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:24:40.297 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:24:40.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.150) 0:01:14.367 ******* 2020-11-20T11:24:40.488 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:24:40.489 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:24:40.541 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.208) 0:01:14.576 ******* 2020-11-20T11:24:40.547 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:24:40.549 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:24:40.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.042) 0:01:14.618 ******* 2020-11-20T11:24:40.655 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:24:40.656 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:24:40.701 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.117) 0:01:14.736 ******* 2020-11-20T11:24:40.824 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi105.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:24:40.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.167) 0:01:14.903 ******* 2020-11-20T11:24:40.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:40 +0000 (0:00:00.031) 0:01:14.934 ******* 2020-11-20T11:24:41.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:24:41.090 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:24:41.123 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.223) 0:01:15.158 ******* 2020-11-20T11:24:41.185 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:24:41.186 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:24:41.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.097) 0:01:15.256 ******* 2020-11-20T11:24:41.346 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:24:41.348 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:24:41.382 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.160) 0:01:15.417 ******* 2020-11-20T11:24:41.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:24:41.400 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:24:41.436 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.052) 0:01:15.469 ******* 2020-11-20T11:24:41.889 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:24:41.924 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.489) 0:01:15.959 ******* 2020-11-20T11:24:41.953 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:24:41.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:41 +0000 (0:00:00.074) 0:01:16.034 ******* 2020-11-20T11:24:42.492 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:24:42.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:42 +0000 (0:00:00.530) 0:01:16.564 ******* 2020-11-20T11:24:43.055 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:24:43.057 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.637172", "end": "2020-11-20 11:24:43.028594", "rc": 0, "start": "2020-11-20 11:24:41.391422", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:43.102 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:43 +0000 (0:00:00.572) 0:01:17.137 ******* 2020-11-20T11:24:43.606 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:24:43.608 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T11:24:43.856 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:24:43.858 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.587196", "end": "2020-11-20 11:24:43.833764", "rc": 0, "start": "2020-11-20 11:24:42.246568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:43.890 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:43 +0000 (0:00:00.788) 0:01:17.925 ******* 2020-11-20T11:24:44.047 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi100.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T11:24:44.366 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T11:24:44.474 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T11:24:44.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:44 +0000 (0:00:00.619) 0:01:18.545 ******* 2020-11-20T11:24:44.548 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:24:44.550 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.801612", "end": "2020-11-20 11:24:44.518813", "rc": 0, "start": "2020-11-20 11:24:42.717201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:24:44.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:44 +0000 (0:00:00.076) 0:01:18.621 ******* 2020-11-20T11:24:44.808 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:24:44.811 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T11:24:44.999 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:24:45.001 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:24:45.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:45 +0000 (0:00:00.448) 0:01:19.070 ******* 2020-11-20T11:24:45.096 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi067.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T11:24:45.235 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T11:24:45.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:45 +0000 (0:00:00.236) 0:01:19.307 ******* 2020-11-20T11:24:45.521 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:45.523 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T11:24:45.554 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:24:45.556 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T11:24:45.747 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:24:45.749 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:24:45.783 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:45 +0000 (0:00:00.510) 0:01:19.818 ******* 2020-11-20T11:24:45.958 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:45.960 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T11:24:46.024 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:24:46.026 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T11:24:46.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.277) 0:01:20.095 ******* 2020-11-20T11:24:46.294 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:46.296 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T11:24:46.431 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T11:24:46.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.423) 0:01:20.518 ******* 2020-11-20T11:24:46.511 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:24:46.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.062) 0:01:20.582 ******* 2020-11-20T11:24:46.575 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:46.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.065) 0:01:20.647 ******* 2020-11-20T11:24:46.629 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:24:46.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.055) 0:01:20.702 ******* 2020-11-20T11:24:46.674 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:24:46.675 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:46.710 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.042) 0:01:20.745 ******* 2020-11-20T11:24:46.737 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:24:46.739 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:46.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.062) 0:01:20.808 ******* 2020-11-20T11:24:46.780 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:46.782 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T11:24:46.803 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T11:24:46.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.064) 0:01:20.872 ******* 2020-11-20T11:24:46.875 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:24:46.878 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:46.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.070) 0:01:20.943 ******* 2020-11-20T11:24:46.946 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:24:46.947 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:46.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:46 +0000 (0:00:00.070) 0:01:21.014 ******* 2020-11-20T11:24:47.157 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:47.221 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi100.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006723", "end": "2020-11-20 11:24:47.164164", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:24:47.157441", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi105.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1 2020-11-20T11:24:47.222 INFO:teuthology.task.ansible.out:, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T11:24:47.229 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.249) 0:01:21.263 ******* 2020-11-20T11:24:47.274 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.044) 0:01:21.308 ******* 2020-11-20T11:24:47.284 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:24:47.289 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.048) 0:01:21.357 ******* 2020-11-20T11:24:47.329 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:24:47.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.043) 0:01:21.400 ******* 2020-11-20T11:24:47.417 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.101) 0:01:21.501 ******* 2020-11-20T11:24:47.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.100) 0:01:21.602 ******* 2020-11-20T11:24:47.597 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.628 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.060) 0:01:21.663 ******* 2020-11-20T11:24:47.666 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T11:24:47.700 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.072) 0:01:21.735 ******* 2020-11-20T11:24:47.737 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.074) 0:01:21.809 ******* 2020-11-20T11:24:47.780 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:24:47.782 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T11:24:47.805 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:24:47.806 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:47.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:47 +0000 (0:00:00.065) 0:01:21.874 ******* 2020-11-20T11:24:48.055 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:24:48.057 INFO:teuthology.task.ansible.out:fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006962", "end": "2020-11-20 11:24:48.030390", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:24:48.023428", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:24:48.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.250) 0:01:22.125 ******* 2020-11-20T11:24:48.127 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.071) 0:01:22.196 ******* 2020-11-20T11:24:48.235 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi067.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T11:24:48.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.114) 0:01:22.311 ******* 2020-11-20T11:24:48.309 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:24:48.345 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.069) 0:01:22.380 ******* 2020-11-20T11:24:48.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.071) 0:01:22.451 ******* 2020-11-20T11:24:48.455 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:24:48.457 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.467 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.084) 0:01:22.536 ******* 2020-11-20T11:24:48.528 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:24:48.529 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.060) 0:01:22.596 ******* 2020-11-20T11:24:48.588 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:24:48.590 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T11:24:48.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.060) 0:01:22.657 ******* 2020-11-20T11:24:48.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:24:48.661 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.075) 0:01:22.732 ******* 2020-11-20T11:24:48.724 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:24:48.726 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:48.758 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:48 +0000 (0:00:00.061) 0:01:22.793 ******* 2020-11-20T11:24:48.988 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:24:48.990 INFO:teuthology.task.ansible.out:fatal: [smithi067.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007023", "end": "2020-11-20 11:24:48.961465", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:24:48.954442", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:24:49.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:49 +0000 (0:00:00.262) 0:01:23.056 ******* 2020-11-20T11:24:49.048 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:49.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:49 +0000 (0:00:00.061) 0:01:23.117 ******* 2020-11-20T11:24:49.596 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:24:49.598 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:24:49.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:49 +0000 (0:00:00.549) 0:01:23.666 ******* 2020-11-20T11:24:50.389 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:24:50.424 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:50 +0000 (0:00:00.792) 0:01:24.459 ******* 2020-11-20T11:24:51.299 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:24:51.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:51 +0000 (0:00:00.909) 0:01:25.368 ******* 2020-11-20T11:24:51.583 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:24:51.585 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:51.630 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:51 +0000 (0:00:00.296) 0:01:25.665 ******* 2020-11-20T11:24:52.212 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:52.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:52 +0000 (0:00:00.614) 0:01:26.280 ******* 2020-11-20T11:24:53.335 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:53.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:53 +0000 (0:00:01.125) 0:01:27.405 ******* 2020-11-20T11:24:54.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:24:54.723 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:54.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:54 +0000 (0:00:01.386) 0:01:28.792 ******* 2020-11-20T11:24:54.783 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:24:54.785 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:54.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:54 +0000 (0:00:00.059) 0:01:28.852 ******* 2020-11-20T11:24:55.187 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:24:55.189 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:55.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:55 +0000 (0:00:00.405) 0:01:29.258 ******* 2020-11-20T11:24:55.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:55.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:55 +0000 (0:00:00.061) 0:01:29.319 ******* 2020-11-20T11:24:55.750 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:24:55.752 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:24:55.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:55 +0000 (0:00:00.500) 0:01:29.819 ******* 2020-11-20T11:24:55.812 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:24:55.814 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:55.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:55 +0000 (0:00:00.061) 0:01:29.881 ******* 2020-11-20T11:24:56.147 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:24:56.150 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target basic.target dbus.service dbus.socket polkit.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service shutdown.target ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-20T11:24:56.152 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", 2020-11-20T11:24:56.154 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-20T11:24:56.155 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:24:56.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:56 +0000 (0:00:00.336) 0:01:30.217 ******* 2020-11-20T11:24:56.232 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:24:56.233 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:24:56.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:56 +0000 (0:00:00.099) 0:01:30.318 ******* 2020-11-20T11:24:56.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:24:56.325 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:56.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:56 +0000 (0:00:00.074) 0:01:30.392 ******* 2020-11-20T11:24:56.474 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi100.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:24:56.527 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:56 +0000 (0:00:00.169) 0:01:30.562 ******* 2020-11-20T11:24:56.727 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:24:56.728 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice sysinit.target dbus.service polkit.service dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service shutdown.target ebtables.service ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-20T11:24:56.729 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", 2020-11-20T11:24:56.731 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-20T11:24:56.732 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:24:56.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:56 +0000 (0:00:00.236) 0:01:30.798 ******* 2020-11-20T11:24:57.059 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:24:57.061 INFO:teuthology.task.ansible.out:fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:24:57.096 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.332) 0:01:31.131 ******* 2020-11-20T11:24:57.102 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:24:57.103 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T11:24:57.149 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.045) 0:01:31.176 ******* 2020-11-20T11:24:57.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.069) 0:01:31.245 ******* 2020-11-20T11:24:57.270 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:24:57.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.103) 0:01:31.348 ******* 2020-11-20T11:24:57.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:24:57.343 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.378 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.064) 0:01:31.413 ******* 2020-11-20T11:24:57.395 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:24:57.404 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:24:57.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.052) 0:01:31.466 ******* 2020-11-20T11:24:57.437 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:24:57.440 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.047) 0:01:31.514 ******* 2020-11-20T11:24:57.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.044) 0:01:31.558 ******* 2020-11-20T11:24:57.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.041) 0:01:31.600 ******* 2020-11-20T11:24:57.572 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:24:57.575 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.046) 0:01:31.646 ******* 2020-11-20T11:24:57.618 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.042) 0:01:31.689 ******* 2020-11-20T11:24:57.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:24:57.664 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.044) 0:01:31.733 ******* 2020-11-20T11:24:57.705 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:24:57.706 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.044) 0:01:31.778 ******* 2020-11-20T11:24:57.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:24:57.750 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.044) 0:01:31.822 ******* 2020-11-20T11:24:57.794 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:24:57.796 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.045) 0:01:31.868 ******* 2020-11-20T11:24:57.839 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:24:57.841 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.877 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.044) 0:01:31.912 ******* 2020-11-20T11:24:57.883 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:24:57.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.046) 0:01:31.958 ******* 2020-11-20T11:24:57.933 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:24:57.936 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:57.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:57 +0000 (0:00:00.054) 0:01:32.013 ******* 2020-11-20T11:24:57.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:24:57.990 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.025 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.046) 0:01:32.060 ******* 2020-11-20T11:24:58.032 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:24:58.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.046) 0:01:32.107 ******* 2020-11-20T11:24:58.078 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:24:58.080 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.040) 0:01:32.148 ******* 2020-11-20T11:24:58.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:24:58.121 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.043) 0:01:32.191 ******* 2020-11-20T11:24:58.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:24:58.164 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.041) 0:01:32.232 ******* 2020-11-20T11:24:58.205 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.257 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.059) 0:01:32.292 ******* 2020-11-20T11:24:58.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:24:58.267 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.047) 0:01:32.339 ******* 2020-11-20T11:24:58.311 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:24:58.313 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.347 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.042) 0:01:32.382 ******* 2020-11-20T11:24:58.353 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:24:58.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.064) 0:01:32.446 ******* 2020-11-20T11:24:58.420 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:24:58.423 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:24:58.465 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.054) 0:01:32.500 ******* 2020-11-20T11:24:58.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.032) 0:01:32.533 ******* 2020-11-20T11:24:58.504 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:24:58.506 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.042) 0:01:32.575 ******* 2020-11-20T11:24:58.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:24:58.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.043) 0:01:32.618 ******* 2020-11-20T11:24:58.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.032) 0:01:32.651 ******* 2020-11-20T11:24:58.622 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:24:58.624 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.060) 0:01:32.712 ******* 2020-11-20T11:24:58.702 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.755 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.076) 0:01:32.789 ******* 2020-11-20T11:24:58.761 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.820 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.066) 0:01:32.855 ******* 2020-11-20T11:24:58.828 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:24:58.830 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.045) 0:01:32.900 ******* 2020-11-20T11:24:58.871 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:24:58.873 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.045) 0:01:32.946 ******* 2020-11-20T11:24:58.918 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:58.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:58 +0000 (0:00:00.047) 0:01:32.993 ******* 2020-11-20T11:24:58.971 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.socket dbus.service sysinit.target system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service ip6tables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-11-20T11:24:58.975 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-11-20T11:24:58.977 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-11-20T11:24:58.979 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.071) 0:01:33.064 ******* 2020-11-20T11:24:59.064 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.034) 0:01:33.099 ******* 2020-11-20T11:24:59.073 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.119 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.054) 0:01:33.153 ******* 2020-11-20T11:24:59.125 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:24:59.127 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.184 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.065) 0:01:33.219 ******* 2020-11-20T11:24:59.195 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.071) 0:01:33.290 ******* 2020-11-20T11:24:59.266 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.311 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.055) 0:01:33.346 ******* 2020-11-20T11:24:59.323 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.064) 0:01:33.410 ******* 2020-11-20T11:24:59.383 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:24:59.384 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.384 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi067.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:24:59.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.057) 0:01:33.467 ******* 2020-11-20T11:24:59.469 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.031) 0:01:33.499 ******* 2020-11-20T11:24:59.472 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.052) 0:01:33.552 ******* 2020-11-20T11:24:59.525 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.046) 0:01:33.599 ******* 2020-11-20T11:24:59.572 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:24:59.574 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.624 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.059) 0:01:33.659 ******* 2020-11-20T11:24:59.632 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:24:59.634 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.046) 0:01:33.706 ******* 2020-11-20T11:24:59.677 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:24:59.679 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.045) 0:01:33.751 ******* 2020-11-20T11:24:59.724 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:24:59.727 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.052) 0:01:33.803 ******* 2020-11-20T11:24:59.774 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:24:59.776 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.042) 0:01:33.846 ******* 2020-11-20T11:24:59.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.039) 0:01:33.886 ******* 2020-11-20T11:24:59.859 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.054) 0:01:33.941 ******* 2020-11-20T11:24:59.947 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.040) 0:01:33.982 ******* 2020-11-20T11:24:59.953 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:24:59.955 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:24:59.998 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:24:59 +0000 (0:00:00.050) 0:01:34.033 ******* 2020-11-20T11:25:00.037 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.037) 0:01:34.070 ******* 2020-11-20T11:25:00.042 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:25:00.043 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.053) 0:01:34.124 ******* 2020-11-20T11:25:00.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.043) 0:01:34.167 ******* 2020-11-20T11:25:00.149 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.178 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.046) 0:01:34.213 ******* 2020-11-20T11:25:00.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.036) 0:01:34.250 ******* 2020-11-20T11:25:00.222 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:25:00.224 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.047) 0:01:34.297 ******* 2020-11-20T11:25:00.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.033) 0:01:34.330 ******* 2020-11-20T11:25:00.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.337 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.041) 0:01:34.372 ******* 2020-11-20T11:25:00.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.032) 0:01:34.404 ******* 2020-11-20T11:25:00.376 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:25:00.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.045) 0:01:34.450 ******* 2020-11-20T11:25:00.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.033) 0:01:34.484 ******* 2020-11-20T11:25:00.460 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.049) 0:01:34.533 ******* 2020-11-20T11:25:00.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.058) 0:01:34.591 ******* 2020-11-20T11:25:00.568 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.569 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.607 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.050) 0:01:34.642 ******* 2020-11-20T11:25:00.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.032) 0:01:34.675 ******* 2020-11-20T11:25:00.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:25:00.648 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:25:00.650 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.685 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.045) 0:01:34.720 ******* 2020-11-20T11:25:00.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.032) 0:01:34.752 ******* 2020-11-20T11:25:00.725 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.042) 0:01:34.795 ******* 2020-11-20T11:25:00.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.035) 0:01:34.830 ******* 2020-11-20T11:25:00.802 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:25:00.803 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:25:00.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.042) 0:01:34.872 ******* 2020-11-20T11:25:00.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.031) 0:01:34.904 ******* 2020-11-20T11:25:00.875 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:25:00.877 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.039) 0:01:34.944 ******* 2020-11-20T11:25:00.941 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.031) 0:01:34.976 ******* 2020-11-20T11:25:00.947 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:25:00.950 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:00.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:00 +0000 (0:00:00.040) 0:01:35.017 ******* 2020-11-20T11:25:01.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.031) 0:01:35.048 ******* 2020-11-20T11:25:01.019 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:25:01.023 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.041) 0:01:35.090 ******* 2020-11-20T11:25:01.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.036) 0:01:35.126 ******* 2020-11-20T11:25:01.097 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:25:01.099 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.041) 0:01:35.167 ******* 2020-11-20T11:25:01.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.031) 0:01:35.199 ******* 2020-11-20T11:25:01.170 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:25:01.172 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.041) 0:01:35.240 ******* 2020-11-20T11:25:01.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.031) 0:01:35.272 ******* 2020-11-20T11:25:01.243 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:25:01.245 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.279 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.041) 0:01:35.314 ******* 2020-11-20T11:25:01.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.030) 0:01:35.344 ******* 2020-11-20T11:25:01.315 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:25:01.317 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.043) 0:01:35.388 ******* 2020-11-20T11:25:01.389 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.035) 0:01:35.423 ******* 2020-11-20T11:25:01.396 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:25:01.397 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.432 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.043) 0:01:35.467 ******* 2020-11-20T11:25:01.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.031) 0:01:35.498 ******* 2020-11-20T11:25:01.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:25:01.471 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.045) 0:01:35.544 ******* 2020-11-20T11:25:01.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.031) 0:01:35.575 ******* 2020-11-20T11:25:01.546 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:25:01.547 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.042) 0:01:35.618 ******* 2020-11-20T11:25:01.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.033) 0:01:35.651 ******* 2020-11-20T11:25:01.623 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:01.625 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.043) 0:01:35.695 ******* 2020-11-20T11:25:01.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.033) 0:01:35.729 ******* 2020-11-20T11:25:01.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:25:01.703 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.739 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.044) 0:01:35.774 ******* 2020-11-20T11:25:01.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.033) 0:01:35.808 ******* 2020-11-20T11:25:01.779 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:25:01.784 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.816 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.043) 0:01:35.851 ******* 2020-11-20T11:25:01.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.034) 0:01:35.885 ******* 2020-11-20T11:25:01.858 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.896 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.045) 0:01:35.931 ******* 2020-11-20T11:25:01.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.032) 0:01:35.964 ******* 2020-11-20T11:25:01.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:25:01.937 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:01.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:01 +0000 (0:00:00.045) 0:01:36.009 ******* 2020-11-20T11:25:02.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.031) 0:01:36.041 ******* 2020-11-20T11:25:02.014 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:25:02.015 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.051) 0:01:36.092 ******* 2020-11-20T11:25:02.105 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.047) 0:01:36.140 ******* 2020-11-20T11:25:02.113 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:25:02.115 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.152 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.047) 0:01:36.187 ******* 2020-11-20T11:25:02.188 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.036) 0:01:36.223 ******* 2020-11-20T11:25:02.195 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:25:02.197 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.062) 0:01:36.286 ******* 2020-11-20T11:25:02.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.039) 0:01:36.325 ******* 2020-11-20T11:25:02.297 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.043) 0:01:36.369 ******* 2020-11-20T11:25:02.342 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:25:02.344 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.398 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.063) 0:01:36.433 ******* 2020-11-20T11:25:02.430 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.031) 0:01:36.465 ******* 2020-11-20T11:25:02.436 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:25:02.438 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.044) 0:01:36.510 ******* 2020-11-20T11:25:02.482 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:25:02.484 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.047) 0:01:36.558 ******* 2020-11-20T11:25:02.528 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:25:02.531 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.056) 0:01:36.614 ******* 2020-11-20T11:25:02.587 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-11-20T11:25:02.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.044) 0:01:36.658 ******* 2020-11-20T11:25:02.630 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:25:02.632 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.041) 0:01:36.700 ******* 2020-11-20T11:25:02.692 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:02.694 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.060) 0:01:36.761 ******* 2020-11-20T11:25:02.743 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:25:02.745 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-11-20T11:25:02.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.051) 0:01:36.813 ******* 2020-11-20T11:25:02.784 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:25:02.787 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.820 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.041) 0:01:36.854 ******* 2020-11-20T11:25:02.836 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:02.839 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:02.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.051) 0:01:36.906 ******* 2020-11-20T11:25:02.878 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:25:02.880 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.041) 0:01:36.948 ******* 2020-11-20T11:25:02.940 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:25:02.942 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:02.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:02 +0000 (0:00:00.061) 0:01:37.009 ******* 2020-11-20T11:25:02.981 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:02.983 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:03.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.062) 0:01:37.071 ******* 2020-11-20T11:25:03.042 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:25:03.044 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.041) 0:01:37.113 ******* 2020-11-20T11:25:03.085 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:25:03.087 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-11-20T11:25:03.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.042) 0:01:37.156 ******* 2020-11-20T11:25:03.160 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:25:03.162 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.089) 0:01:37.245 ******* 2020-11-20T11:25:03.231 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:25:03.233 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.059) 0:01:37.304 ******* 2020-11-20T11:25:03.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.034) 0:01:37.339 ******* 2020-11-20T11:25:03.310 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:25:03.311 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.041) 0:01:37.380 ******* 2020-11-20T11:25:03.353 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:25:03.354 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.045) 0:01:37.426 ******* 2020-11-20T11:25:03.426 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.034) 0:01:37.460 ******* 2020-11-20T11:25:03.431 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:25:03.433 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.468 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.042) 0:01:37.503 ******* 2020-11-20T11:25:03.475 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.045) 0:01:37.549 ******* 2020-11-20T11:25:03.520 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:03.522 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.042) 0:01:37.591 ******* 2020-11-20T11:25:03.563 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:25:03.565 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.057) 0:01:37.649 ******* 2020-11-20T11:25:03.621 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:25:03.623 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:03.623 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:03.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.047) 0:01:37.697 ******* 2020-11-20T11:25:03.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.032) 0:01:37.730 ******* 2020-11-20T11:25:03.702 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:25:03.704 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.047) 0:01:37.778 ******* 2020-11-20T11:25:03.749 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.041) 0:01:37.820 ******* 2020-11-20T11:25:03.791 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:03.793 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.048) 0:01:37.868 ******* 2020-11-20T11:25:03.840 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:03.842 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.878 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.041) 0:01:37.910 ******* 2020-11-20T11:25:03.938 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} Friday 20 November 2020 11:25:03 +0000 (0:00:00.053) 0:01:37.964 ******* 2020-11-20T11:25:03.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:03 +0000 (0:00:00.042) 0:01:38.007 ******* 2020-11-20T11:25:03.978 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:03.980 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.014 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.041) 0:01:38.048 ******* 2020-11-20T11:25:04.051 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.037) 0:01:38.086 ******* 2020-11-20T11:25:04.062 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:25:04.065 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.099 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.048) 0:01:38.134 ******* 2020-11-20T11:25:04.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.032) 0:01:38.166 ******* 2020-11-20T11:25:04.138 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:25:04.140 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.042) 0:01:38.209 ******* 2020-11-20T11:25:04.209 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.034) 0:01:38.244 ******* 2020-11-20T11:25:04.216 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:25:04.218 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.061) 0:01:38.306 ******* 2020-11-20T11:25:04.311 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.040) 0:01:38.346 ******* 2020-11-20T11:25:04.321 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.056) 0:01:38.402 ******* 2020-11-20T11:25:04.408 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.040) 0:01:38.443 ******* 2020-11-20T11:25:04.416 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:25:04.418 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.055) 0:01:38.498 ******* 2020-11-20T11:25:04.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.034) 0:01:38.533 ******* 2020-11-20T11:25:04.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:25:04.507 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.055) 0:01:38.588 ******* 2020-11-20T11:25:04.591 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.037) 0:01:38.626 ******* 2020-11-20T11:25:04.598 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.054) 0:01:38.680 ******* 2020-11-20T11:25:04.690 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.044) 0:01:38.725 ******* 2020-11-20T11:25:04.696 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:25:04.699 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.735 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.044) 0:01:38.770 ******* 2020-11-20T11:25:04.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.032) 0:01:38.803 ******* 2020-11-20T11:25:04.776 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.043) 0:01:38.846 ******* 2020-11-20T11:25:04.844 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.033) 0:01:38.879 ******* 2020-11-20T11:25:04.851 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:25:04.853 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.890 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.045) 0:01:38.925 ******* 2020-11-20T11:25:04.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.030) 0:01:38.955 ******* 2020-11-20T11:25:04.927 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:25:04.929 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:04.963 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.042) 0:01:38.998 ******* 2020-11-20T11:25:04.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:04 +0000 (0:00:00.030) 0:01:39.029 ******* 2020-11-20T11:25:05.000 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:25:05.002 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.041) 0:01:39.070 ******* 2020-11-20T11:25:05.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.037) 0:01:39.108 ******* 2020-11-20T11:25:05.083 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.084 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.052) 0:01:39.161 ******* 2020-11-20T11:25:05.158 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.032) 0:01:39.193 ******* 2020-11-20T11:25:05.165 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.046) 0:01:39.240 ******* 2020-11-20T11:25:05.252 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.046) 0:01:39.286 ******* 2020-11-20T11:25:05.258 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:25:05.260 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.051) 0:01:39.338 ******* 2020-11-20T11:25:05.347 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.043) 0:01:39.382 ******* 2020-11-20T11:25:05.356 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:25:05.359 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.409 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.061) 0:01:39.444 ******* 2020-11-20T11:25:05.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.035) 0:01:39.479 ******* 2020-11-20T11:25:05.451 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:25:05.453 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.041) 0:01:39.521 ******* 2020-11-20T11:25:05.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.031) 0:01:39.552 ******* 2020-11-20T11:25:05.523 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.525 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.047) 0:01:39.599 ******* 2020-11-20T11:25:05.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.048) 0:01:39.648 ******* 2020-11-20T11:25:05.621 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:25:05.622 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.622 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:25:05.623 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.057) 0:01:39.706 ******* 2020-11-20T11:25:05.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.035) 0:01:39.741 ******* 2020-11-20T11:25:05.713 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:25:05.716 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.044) 0:01:39.786 ******* 2020-11-20T11:25:05.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.034) 0:01:39.820 ******* 2020-11-20T11:25:05.792 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:25:05.794 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.042) 0:01:39.862 ******* 2020-11-20T11:25:05.859 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.031) 0:01:39.893 ******* 2020-11-20T11:25:05.865 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.867 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:25:05.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.055) 0:01:39.949 ******* 2020-11-20T11:25:05.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:05 +0000 (0:00:00.043) 0:01:39.993 ******* 2020-11-20T11:25:05.967 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:25:05.969 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:05.970 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:25:05.971 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.047) 0:01:40.040 ******* 2020-11-20T11:25:06.014 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:25:06.015 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:25:06.016 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.016 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.019 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.051) 0:01:40.092 ******* 2020-11-20T11:25:06.088 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.031) 0:01:40.123 ******* 2020-11-20T11:25:06.095 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:25:06.096 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.042) 0:01:40.165 ******* 2020-11-20T11:25:06.136 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:25:06.139 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.172 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.041) 0:01:40.206 ******* 2020-11-20T11:25:06.178 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:25:06.179 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.044) 0:01:40.251 ******* 2020-11-20T11:25:06.222 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:06.224 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:25:06.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.041) 0:01:40.293 ******* 2020-11-20T11:25:06.264 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:25:06.266 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi067.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003569", "end": "2020-11-20 11:25:06.226189", "rc": 0, "start": "2020-11-20 11:25:06.222620", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:25:06.308 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.050) 0:01:40.343 ******* 2020-11-20T11:25:06.340 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.031) 0:01:40.375 ******* 2020-11-20T11:25:06.346 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:25:06.348 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi100.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi100.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.348 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.348 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.349 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi100.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.349 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.050) 0:01:40.426 ******* 2020-11-20T11:25:06.398 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.399 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.059) 0:01:40.485 ******* 2020-11-20T11:25:06.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.061) 0:01:40.547 ******* 2020-11-20T11:25:06.518 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:25:06.520 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.042) 0:01:40.590 ******* 2020-11-20T11:25:06.562 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:06.564 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:25:06.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.042) 0:01:40.632 ******* 2020-11-20T11:25:06.603 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:25:06.605 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.649 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.051) 0:01:40.684 ******* 2020-11-20T11:25:06.657 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:25:06.659 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.669 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:25:06.671 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi105.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.055) 0:01:40.739 ******* 2020-11-20T11:25:06.712 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:25:06.714 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.008936", "end": "2020-11-20 11:25:06.651040", "rc": 0, "start": "2020-11-20 11:25:06.642104", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi105.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.049) 0:01:40.788 ******* 2020-11-20T11:25:06.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.041) 0:01:40.830 ******* 2020-11-20T11:25:06.804 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:25:06.807 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.862 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.066) 0:01:40.897 ******* 2020-11-20T11:25:06.891 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:25:06.892 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.063) 0:01:40.960 ******* 2020-11-20T11:25:06.963 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:06.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:06 +0000 (0:00:00.071) 0:01:41.031 ******* 2020-11-20T11:25:07.026 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:25:07.028 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004596", "end": "2020-11-20 11:25:06.978118", "rc": 0, "start": "2020-11-20 11:25:06.973522", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:25:07.028 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:07.063 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.067) 0:01:41.098 ******* 2020-11-20T11:25:07.106 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.042) 0:01:41.141 ******* 2020-11-20T11:25:07.134 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:07.172 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.065) 0:01:41.207 ******* 2020-11-20T11:25:07.213 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:07.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.072) 0:01:41.280 ******* 2020-11-20T11:25:07.274 INFO:teuthology.task.ansible.out: 2020-11-20T11:25:07.276 INFO:teuthology.task.ansible.out:TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:07.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.066) 0:01:41.347 ******* 2020-11-20T11:25:07.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:25:07.340 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:07.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.060) 0:01:41.407 ******* 2020-11-20T11:25:07.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:25:07.697 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:25:07.732 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.359) 0:01:41.767 ******* 2020-11-20T11:25:07.771 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:25:07.773 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529239040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179990, 'block_used': 12915118, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179990, "block_size": 4096, "block_total": 240095108, "block_used": 12915118, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529239040, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T11:25:07.807 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:07 +0000 (0:00:00.075) 0:01:41.842 ******* 2020-11-20T11:25:08.004 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:25:08.006 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:25:08.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.232) 0:01:42.075 ******* 2020-11-20T11:25:08.047 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:25:08.049 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005296", "end": "2020-11-20 11:25:07.989779", "rc": 0, "start": "2020-11-20 11:25:07.984483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:08.083 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.042) 0:01:42.118 ******* 2020-11-20T11:25:08.090 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:25:08.092 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T11:25:08.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.047) 0:01:42.166 ******* 2020-11-20T11:25:08.139 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:25:08.141 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529239040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179990, 'block_used': 12915118, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179990, "block_size": 4096, "block_total": 240095108, "block_used": 12915118, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529239040, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:08.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.069) 0:01:42.235 ******* 2020-11-20T11:25:08.234 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:25:08.273 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.073) 0:01:42.308 ******* 2020-11-20T11:25:08.329 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:25:08.331 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:25:08.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.098) 0:01:42.406 ******* 2020-11-20T11:25:08.378 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:25:08.380 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005089", "end": "2020-11-20 11:25:08.327004", "rc": 0, "start": "2020-11-20 11:25:08.321915", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:08.426 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.054) 0:01:42.461 ******* 2020-11-20T11:25:08.434 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:25:08.436 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T11:25:08.491 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.065) 0:01:42.526 ******* 2020-11-20T11:25:08.498 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:25:08.500 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:08.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.052) 0:01:42.579 ******* 2020-11-20T11:25:08.571 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:25:08.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.061) 0:01:42.640 ******* 2020-11-20T11:25:08.687 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:25:08.688 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004968", "end": "2020-11-20 11:25:08.663856", "rc": 0, "start": "2020-11-20 11:25:08.658888", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:08.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.116) 0:01:42.757 ******* 2020-11-20T11:25:08.782 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi105.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:08.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.096) 0:01:42.854 ******* 2020-11-20T11:25:08.845 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:25:08.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:08 +0000 (0:00:00.060) 0:01:42.914 ******* 2020-11-20T11:25:09.848 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:25:09.851 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27RfsZXeG2msdWi0kXi9ckzcz7iHPZiDk8'], 'uuids': ['217ea412-e71c-4831-a798-74caff796e1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.328467", "end": "2020-11-20 11:25:09.810456", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27RfsZXeG2msdWi0kXi9ckzcz7iHPZiDk8"], "labels": [], "masters": [], "uuids": ["217ea412-e71c-4831-a798-74caff796e1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:08.481989", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:10.096 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesDkxpvOyo7dS6mGAFqWwXMShE8EunmiT'], 'uuids': ['51d9dbf2-3824-4ca2-a2ca-4e445371455b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.246222", "end": "2020-11-20 11:25:10.049312", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesDkxpvOyo7dS6mGAFqWwXMShE8EunmiT"], "labels": [], "masters": [], "uuids": ["51d9dbf2-3824-4ca2-a2ca-4e445371455b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:08.803090", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:10.409 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pTCuAkNnKxx88c9NCTzGITCFl0SdJP917'], 'uuids': ['ef12d161-0bc0-4481-846b-ebb7dedf1b17'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.289591", "end": "2020-11-20 11:25:10.370572", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pTCuAkNnKxx88c9NCTzGITCFl0SdJP917"], "labels": [], "masters": [], "uuids": ["ef12d161-0bc0-4481-846b-ebb7dedf1b17"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:09.080981", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:11.147 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-ujpfSn-3f3R-jeKQ-HtwV-Py6y-mZwz-sK6Pjw', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN', 'nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.063807", "end": "2020-11-20 11:25:11.108438", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ujpfSn-3f3R-jeKQ-HtwV-Py6y-mZwz-sK6Pjw", "nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN", "nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:10.044631", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:25:11.149 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:11.379 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vUBdTP-U1zX-VVz3-h2NP-W792-p70h-z3LbQx', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN', 'nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.066226", "end": "2020-11-20 11:25:11.343466", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vUBdTP-U1zX-VVz3-h2NP-W792-p70h-z3LbQx", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN", "nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:10.277240", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:25:11.381 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:11.685 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rywqXP-sK4W-57kj-MktQ-l1ed-DGXX-8cKdpU', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN', 'nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.066591", "end": "2020-11-20 11:25:11.651197", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-rywqXP-sK4W-57kj-MktQ-l1ed-DGXX-8cKdpU", "nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN", "nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:10.584606", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:25:11.687 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:12.428 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt272NT8JVoK4PWbN9PCgnstNvP5lybWwcca'], 'uuids': ['948c5ca3-e65f-4786-b8b5-f8183447ad12'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.059980", "end": "2020-11-20 11:25:12.394732", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt272NT8JVoK4PWbN9PCgnstNvP5lybWwcca"], "labels": [], "masters": [], "uuids": ["948c5ca3-e65f-4786-b8b5-f8183447ad12"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:11.334752", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:12.634 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueJbMag7bNStCng6qFO8cxQAX0pTMdGEhC'], 'uuids': ['7a99e63e-eb30-47da-a670-5b184cdf5e78'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.047893", "end": "2020-11-20 11:25:12.597329", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueJbMag7bNStCng6qFO8cxQAX0pTMdGEhC"], "labels": [], "masters": [], "uuids": ["7a99e63e-eb30-47da-a670-5b184cdf5e78"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:11.549436", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:12.933 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pcKFPExLQqSQMGoYwI6H646WBkKEHnsGq'], 'uuids': ['d0868f80-810b-4c30-87eb-b84519fcb949'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.060746", "end": "2020-11-20 11:25:12.904876", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pcKFPExLQqSQMGoYwI6H646WBkKEHnsGq"], "labels": [], "masters": [], "uuids": ["d0868f80-810b-4c30-87eb-b84519fcb949"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:11.844130", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:13.697 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27GSLrBfWfJC10jUXeJ7comloQRpChSYos'], 'uuids': ['32fcb497-08a4-4ee0-b3f6-961cc5a6787e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.055650", "end": "2020-11-20 11:25:13.661527", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27GSLrBfWfJC10jUXeJ7comloQRpChSYos"], "labels": [], "masters": [], "uuids": ["32fcb497-08a4-4ee0-b3f6-961cc5a6787e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:12.605877", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:13.880 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesB7AgDWXapk6S7EOJ8XlgtXMfX4bSxhT'], 'uuids': ['bbf1bfbc-962b-4b52-884c-1e69321f4d4e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049202", "end": "2020-11-20 11:25:13.853358", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesB7AgDWXapk6S7EOJ8XlgtXMfX4bSxhT"], "labels": [], "masters": [], "uuids": ["bbf1bfbc-962b-4b52-884c-1e69321f4d4e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:12.804156", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:14.184 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pMEiEeJrf1eDhNCenq6dQn090uuiZFNxo'], 'uuids': ['561db7a1-8919-44f5-9ac9-0c7655b227ab'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.061018", "end": "2020-11-20 11:25:14.153777", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pMEiEeJrf1eDhNCenq6dQn090uuiZFNxo"], "labels": [], "masters": [], "uuids": ["561db7a1-8919-44f5-9ac9-0c7655b227ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:13.092759", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:14.960 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27TKgbxTBAOk17Xgl8dRyiQ48IBi7jpuqm'], 'uuids': ['2289550c-060d-4064-a786-aa80e987e19f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.058810", "end": "2020-11-20 11:25:14.928802", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27TKgbxTBAOk17Xgl8dRyiQ48IBi7jpuqm"], "labels": [], "masters": [], "uuids": ["2289550c-060d-4064-a786-aa80e987e19f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:13.869992", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:14.972 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M', 'wwn-0x5000c50087b8c354'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4W31M', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b8c354', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M-part1', 'wwn-0x5000c50087b8c354-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M", "wwn-0x5000c50087b8c354"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M-part1", "wwn-0x5000c50087b8c354-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W31M", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8c354"}}, 2020-11-20T11:25:14.974 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:15.132 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3Zue0zgceUFJM0VjGAv4LavXSvKEl4XDqhOz'], 'uuids': ['97957b18-aad4-41d5-a353-07f44b4a11dc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.049802", "end": "2020-11-20 11:25:15.095735", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3Zue0zgceUFJM0VjGAv4LavXSvKEl4XDqhOz"], "labels": [], "masters": [], "uuids": ["97957b18-aad4-41d5-a353-07f44b4a11dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:14.045933", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:15.145 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1', 'wwn-0x5000c50091e1a316'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QKL1', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1a316', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1', 'wwn-0x5000c50091e1a316-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1", "wwn-0x5000c50091e1a316"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1", "wwn-0x5000c50091e1a316-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QKL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a316"}}, 2020-11-20T11:25:15.148 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:15.442 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pJisJKgcLXiLMjMi9hYpXPrOnvbFIKhiR'], 'uuids': ['0fb3258d-9355-4d68-a73b-0123186568d8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.059375", "end": "2020-11-20 11:25:15.405254", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pJisJKgcLXiLMjMi9hYpXPrOnvbFIKhiR"], "labels": [], "masters": [], "uuids": ["0fb3258d-9355-4d68-a73b-0123186568d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:14.345879", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:15.444 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCTR', 'wwn-0x5000c50091e03324'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QCTR', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e03324', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1', 'wwn-0x5000c50091e03324-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR", "wwn-0x5000c50091e03324"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1", "wwn-0x5000c50091e03324-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCTR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e03324"}}, 2020-11-20T11:25:15.445 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:16.233 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27JxOpAiEN3FR4I9g232LuiDSR9j6BVKI4'], 'uuids': ['de71de5a-7b3f-4837-8c31-46ab3c7e1985'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060088", "end": "2020-11-20 11:25:16.203801", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27JxOpAiEN3FR4I9g232LuiDSR9j6BVKI4"], "labels": [], "masters": [], "uuids": ["de71de5a-7b3f-4837-8c31-46ab3c7e1985"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:15.143713", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:25:17.329 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:16 +0000 (0:00:07.394) 0:01:50.308 ******* changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueISCHcjZLlQcCA8zO6pSXbLpG1oxiDuD4'], 'uuids': ['d7473154-9bc4-4f2e-865c-6cccffd66e51'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.062152", "end": "2020-11-20 11:25:16.371867", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueISCHcjZLlQcCA8zO6pSXbLpG1oxiDuD4"], "labels": [], "masters": [], "uuids": ["d7473154-9bc4-4f2e-865c-6cccffd66e51"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:15.309715", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-11-20T11:25:17.331 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} Friday 20 November 2020 11:25:16 +0000 (0:00:00.178) 0:01:50.487 ******* TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27RfsZXeG2msdWi0kXi9ckzcz7iHPZiDk8'], 'uuids': ['217ea412-e71c-4831-a798-74caff796e1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138745", "end": "2020-11-20 11:25:16.631825", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27RfsZXeG2msdWi0kXi9ckzcz7iHPZiDk8"], "labels": [], "masters": [], "uuids": ["217ea412-e71c-4831-a798-74caff796e1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:16.493080", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135899 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135899 s, 849 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme- 2020-11-20T11:25:17.332 INFO:teuthology.task.ansible.out:lv_4', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pvXF0xoRG4ZcuTzesRKGoa3gwuDLjXwtq'], 'uuids': ['5158fc6d-50b9-4974-aec5-58db45bee888'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.061337", "end": "2020-11-20 11:25:16.672242", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pvXF0xoRG4ZcuTzesRKGoa3gwuDLjXwtq"], "labels": [], "masters": [], "uuids": ["5158fc6d-50b9-4974-aec5-58db45bee888"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:15.610905", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} Friday 20 November 2020 11:25:16 +0000 (0:00:00.309) 0:01:50.797 ******* TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** change 2020-11-20T11:25:17.334 INFO:teuthology.task.ansible.out:d: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesDkxpvOyo7dS6mGAFqWwXMShE8EunmiT'], 'uuids': ['51d9dbf2-3824-4ca2-a2ca-4e445371455b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139169", "end": "2020-11-20 11:25:16.799899", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesDkxpvOyo7dS6mGAFqWwXMShE8EunmiT"], "labels": [], "masters": [], "uuids": ["51d9dbf2-3824-4ca2-a2ca-4e445371455b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:16.660730", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136607 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136607 s, 844 MB/s"], "stdout": "", "stdout_lines": []} changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-ujpfSn-3f3R-jeKQ-HtwV-Py6y-mZwz-sK6Pjw', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN', 'nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'mod 2020-11-20T11:25:17.336 INFO:teuthology.task.ansible.out:el': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.035934", "end": "2020-11-20 11:25:16.863061", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ujpfSn-3f3R-jeKQ-HtwV-Py6y-mZwz-sK6Pjw", "nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN", "nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:16.827127", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0333824 s, 3.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0333824 s, 3.5 GB/s"], "stdout": "", "stdout_lines": []} changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vUBdTP-U1zX-VVz3-h2NP-W792-p70h-z3LbQx', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN', 'nvme-nvme.8086-50484654363230343030575234303042 2020-11-20T11:25:17.337 INFO:teuthology.task.ansible.out:474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036622", "end": "2020-11-20 11:25:17.015342", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vUBdTP-U1zX-VVz3-h2NP-W792-p70h-z3LbQx", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN", "nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:16.978720", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0340753 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340753 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'id 2020-11-20T11:25:17.339 INFO:teuthology.task.ansible.out:s': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pTCuAkNnKxx88c9NCTzGITCFl0SdJP917'], 'uuids': ['ef12d161-0bc0-4481-846b-ebb7dedf1b17'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.141009", "end": "2020-11-20 11:25:17.097705", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pTCuAkNnKxx88c9NCTzGITCFl0SdJP917"], "labels": [], "masters": [], "uuids": ["ef12d161-0bc0-4481-846b-ebb7dedf1b17"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:16.956696", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138274 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138274 s, 834 MB/s"], "stdout": "", "stdout_lines": []} changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt272NT8JVoK4PWbN9PCgnstNvP5lybWwcca'], 'uuids': ['948c5ca3-e65f-4786-b8b5-f8183447ad12'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '5 2020-11-20T11:25:17.340 INFO:teuthology.task.ansible.out:12', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.150456", "end": "2020-11-20 11:25:17.224182", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt272NT8JVoK4PWbN9PCgnstNvP5lybWwcca"], "labels": [], "masters": [], "uuids": ["948c5ca3-e65f-4786-b8b5-f8183447ad12"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.073726", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147826 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147826 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.352 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rywqXP-sK4W-57kj-MktQ-l1ed-DGXX-8cKdpU', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN', 'nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036926", "end": "2020-11-20 11:25:17.319769", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-rywqXP-sK4W-57kj-MktQ-l1ed-DGXX-8cKdpU", "nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN", "nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.282843", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0344924 s, 3.3 GB/s", "std 2020-11-20T11:25:17.354 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0344924 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.364 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueJbMag7bNStCng6qFO8cxQAX0pTMdGEhC'], 'uuids': ['7a99e63e-eb30-47da-a670-5b184cdf5e78'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139112", "end": "2020-11-20 11:25:17.340630", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueJbMag7bNStCng6qFO8cxQAX0pTMdGEhC"], "labels": [], "masters": [], "uuids": ["7a99e63e-eb30-47da-a670-5b184cdf5e78"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.201518", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136653 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136653 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.587 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27GSLrBfWfJC10jUXeJ7comloQRpChSYos'], 'uuids': ['32fcb497-08a4-4ee0-b3f6-961cc5a6787e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142254", "end": "2020-11-20 11:25:17.555818", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27GSLrBfWfJC10jUXeJ7comloQRpChSYos"], "labels": [], "masters": [], "uuids": ["32fcb497-08a4-4ee0-b3f6-961cc5a6787e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.413564", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139614 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139614 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.684 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pcKFPExLQqSQMGoYwI6H646WBkKEHnsGq'], 'uuids': ['d0868f80-810b-4c30-87eb-b84519fcb949'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140551", "end": "2020-11-20 11:25:17.651949", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pcKFPExLQqSQMGoYwI6H646WBkKEHnsGq"], "labels": [], "masters": [], "uuids": ["d0868f80-810b-4c30-87eb-b84519fcb949"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.511398", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137993 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137993 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.696 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesB7AgDWXapk6S7EOJ8XlgtXMfX4bSxhT'], 'uuids': ['bbf1bfbc-962b-4b52-884c-1e69321f4d4e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.148269", "end": "2020-11-20 11:25:17.667042", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZuesB7AgDWXapk6S7EOJ8XlgtXMfX4bSxhT"], "labels": [], "masters": [], "uuids": ["bbf1bfbc-962b-4b52-884c-1e69321f4d4e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.518773", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145702 s, 792 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145702 s, 792 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.928 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27TKgbxTBAOk17Xgl8dRyiQ48IBi7jpuqm'], 'uuids': ['2289550c-060d-4064-a786-aa80e987e19f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141314", "end": "2020-11-20 11:25:17.901483", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27TKgbxTBAOk17Xgl8dRyiQ48IBi7jpuqm"], "labels": [], "masters": [], "uuids": ["2289550c-060d-4064-a786-aa80e987e19f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.760169", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138625 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138625 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:17.940 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M', 'wwn-0x5000c50087b8c354'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4W31M', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b8c354', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M-part1', 'wwn-0x5000c50087b8c354-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M", "wwn-0x5000c50087b8c354"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M-part1", "wwn-0x5000c50087b8c354-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W31M", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8c354"}}, 2020-11-20T11:25:17.942 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:18.026 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pMEiEeJrf1eDhNCenq6dQn090uuiZFNxo'], 'uuids': ['561db7a1-8919-44f5-9ac9-0c7655b227ab'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138551", "end": "2020-11-20 11:25:17.993876", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pMEiEeJrf1eDhNCenq6dQn090uuiZFNxo"], "labels": [], "masters": [], "uuids": ["561db7a1-8919-44f5-9ac9-0c7655b227ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.855325", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136169 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136169 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.059 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3Zue0zgceUFJM0VjGAv4LavXSvKEl4XDqhOz'], 'uuids': ['97957b18-aad4-41d5-a353-07f44b4a11dc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.150435", "end": "2020-11-20 11:25:18.027816", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3Zue0zgceUFJM0VjGAv4LavXSvKEl4XDqhOz"], "labels": [], "masters": [], "uuids": ["97957b18-aad4-41d5-a353-07f44b4a11dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:17.877381", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14784 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14784 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.060 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1', 'wwn-0x5000c50091e1a316'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QKL1', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1a316', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1', 'wwn-0x5000c50091e1a316-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1", "wwn-0x5000c50091e1a316"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1", "wwn-0x5000c50091e1a316-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QKL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a316"}}, 2020-11-20T11:25:18.062 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:18.261 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27JxOpAiEN3FR4I9g232LuiDSR9j6BVKI4'], 'uuids': ['de71de5a-7b3f-4837-8c31-46ab3c7e1985'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139064", "end": "2020-11-20 11:25:18.237844", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-i9XZ2TmucO1LIDUjhiv36SYU0FnnEt27JxOpAiEN3FR4I9g232LuiDSR9j6BVKI4"], "labels": [], "masters": [], "uuids": ["de71de5a-7b3f-4837-8c31-46ab3c7e1985"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:18.098780", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136508 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136508 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:01.538) 0:01:52.336 ******* 2020-11-20T11:25:18.351 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pJisJKgcLXiLMjMi9hYpXPrOnvbFIKhiR'], 'uuids': ['0fb3258d-9355-4d68-a73b-0123186568d8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141706", "end": "2020-11-20 11:25:18.317931", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pJisJKgcLXiLMjMi9hYpXPrOnvbFIKhiR"], "labels": [], "masters": [], "uuids": ["0fb3258d-9355-4d68-a73b-0123186568d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:18.176225", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139081 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139081 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.352 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCTR', 'wwn-0x5000c50091e03324'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QCTR', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e03324', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1', 'wwn-0x5000c50091e03324-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR", "wwn-0x5000c50091e03324"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1", "wwn-0x5000c50091e03324-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCTR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e03324"}}, 2020-11-20T11:25:18.354 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T11:25:18.377 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueISCHcjZLlQcCA8zO6pSXbLpG1oxiDuD4'], 'uuids': ['d7473154-9bc4-4f2e-865c-6cccffd66e51'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140148", "end": "2020-11-20 11:25:18.352764", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2r7Wr2exDaBQN4NBkKSgwDFs7sgz3ZueISCHcjZLlQcCA8zO6pSXbLpG1oxiDuD4"], "labels": [], "masters": [], "uuids": ["d7473154-9bc4-4f2e-865c-6cccffd66e51"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:18.212616", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137551 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137551 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.117) 0:01:52.453 ******* 2020-11-20T11:25:18.575 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:25:18.576 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.065976", "end": "2020-11-20 11:25:18.541286", "rc": 0, "start": "2020-11-20 11:25:18.475310", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.203) 0:01:52.657 ******* 2020-11-20T11:25:18.677 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:25:18.679 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pvXF0xoRG4ZcuTzesRKGoa3gwuDLjXwtq'], 'uuids': ['5158fc6d-50b9-4974-aec5-58db45bee888'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142240", "end": "2020-11-20 11:25:18.645499", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-5RykfC3r9XWemEQ9kY9If1SEJn27Q94pvXF0xoRG4ZcuTzesRKGoa3gwuDLjXwtq"], "labels": [], "masters": [], "uuids": ["5158fc6d-50b9-4974-aec5-58db45bee888"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:25:18.503259", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139875 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139875 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.208) 0:01:52.865 ******* 2020-11-20T11:25:18.838 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi100.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.080916", "end": "2020-11-20 11:25:18.664091", "rc": 0, "start": "2020-11-20 11:25:18.583175", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.043) 0:01:52.909 ******* 2020-11-20T11:25:18.882 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048274", "end": "2020-11-20 11:25:18.847109", "rc": 0, "start": "2020-11-20 11:25:18.798835", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:18.919 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.044) 0:01:52.954 ******* 2020-11-20T11:25:18.940 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:25:18.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:18 +0000 (0:00:00.078) 0:01:53.032 ******* 2020-11-20T11:25:19.026 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.079 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.081) 0:01:53.113 ******* 2020-11-20T11:25:19.106 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.141 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.062) 0:01:53.176 ******* 2020-11-20T11:25:19.170 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.208 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.065) 0:01:53.242 ******* 2020-11-20T11:25:19.214 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:25:19.217 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046050", "end": "2020-11-20 11:25:19.175176", "rc": 0, "start": "2020-11-20 11:25:19.129126", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:19.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.041) 0:01:53.283 ******* 2020-11-20T11:25:19.255 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:25:19.257 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.069931", "end": "2020-11-20 11:25:19.189010", "rc": 0, "start": "2020-11-20 11:25:19.119079", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.044) 0:01:53.328 ******* 2020-11-20T11:25:19.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.031) 0:01:53.359 ******* 2020-11-20T11:25:19.332 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:25:19.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.055) 0:01:53.415 ******* 2020-11-20T11:25:19.409 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.065) 0:01:53.480 ******* 2020-11-20T11:25:19.473 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:25:19.474 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.060) 0:01:53.541 ******* 2020-11-20T11:25:19.512 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:25:19.514 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:25:19.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.043) 0:01:53.585 ******* 2020-11-20T11:25:19.556 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:25:19.558 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.046) 0:01:53.632 ******* 2020-11-20T11:25:19.604 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:25:19.607 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047376", "end": "2020-11-20 11:25:19.545934", "rc": 0, "start": "2020-11-20 11:25:19.498558", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set root disk] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529239040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179990, 'block_used': 12915118, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179990, "block_size": 4096, "block_total": 240095108, "block_used": 12915118, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529239040, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.046) 0:01:53.678 ******* 2020-11-20T11:25:19.680 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.031) 0:01:53.710 ******* 2020-11-20T11:25:19.682 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.043) 0:01:53.753 ******* 2020-11-20T11:25:19.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.034) 0:01:53.788 ******* 2020-11-20T11:25:19.760 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:25:19.764 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.044) 0:01:53.832 ******* 2020-11-20T11:25:19.834 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.035) 0:01:53.868 ******* 2020-11-20T11:25:19.839 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:19.841 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.875 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.042) 0:01:53.910 ******* 2020-11-20T11:25:19.881 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:25:19.883 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.045) 0:01:53.956 ******* 2020-11-20T11:25:19.926 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:25:19.928 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:19.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:19 +0000 (0:00:00.047) 0:01:54.003 ******* 2020-11-20T11:25:19.977 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:25:19.979 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.085) 0:01:54.089 ******* 2020-11-20T11:25:20.105 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.051) 0:01:54.140 ******* 2020-11-20T11:25:20.113 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:25:20.115 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set root disk] ************************************************ skipping: [smithi100.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.053) 0:01:54.194 ******* 2020-11-20T11:25:20.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.044) 0:01:54.239 ******* 2020-11-20T11:25:20.212 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:25:20.214 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.044) 0:01:54.283 ******* 2020-11-20T11:25:20.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.033) 0:01:54.317 ******* 2020-11-20T11:25:20.289 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:25:20.291 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.050) 0:01:54.368 ******* 2020-11-20T11:25:20.340 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:25:20.343 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.041) 0:01:54.410 ******* 2020-11-20T11:25:20.381 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:20.382 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.047) 0:01:54.458 ******* 2020-11-20T11:25:20.461 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.066) 0:01:54.524 ******* 2020-11-20T11:25:20.518 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:25:20.520 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.064) 0:01:54.589 ******* 2020-11-20T11:25:20.595 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:25:20.598 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:25:20.632 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.077) 0:01:54.667 ******* 2020-11-20T11:25:20.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.032) 0:01:54.700 ******* 2020-11-20T11:25:20.671 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:25:20.672 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.042) 0:01:54.742 ******* 2020-11-20T11:25:20.713 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:25:20.715 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529275904, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179999, 'block_used': 12915109, 'inode_total': 61054976, 'inode_available': 60990124, 'inode_used': 64852, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179999, "block_size": 4096, "block_total": 240095108, "block_used": 12915109, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990124, "inode_total": 61054976, "inode_used": 64852, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529275904, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.044) 0:01:54.786 ******* 2020-11-20T11:25:20.779 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:25:20.781 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.061) 0:01:54.847 ******* 2020-11-20T11:25:20.840 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:20.842 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.878 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.066) 0:01:54.913 ******* 2020-11-20T11:25:20.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:25:20.887 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:25:20.930 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.051) 0:01:54.965 ******* 2020-11-20T11:25:20.937 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:20.939 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:20.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:20 +0000 (0:00:00.051) 0:01:55.017 ******* 2020-11-20T11:25:21.021 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:25:21.022 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:21.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:21 +0000 (0:00:00.074) 0:01:55.091 ******* 2020-11-20T11:25:21.082 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:25:21.084 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:21.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:21 +0000 (0:00:00.059) 0:01:55.150 ******* 2020-11-20T11:25:21.131 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:25:21.133 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:25:21.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:21 +0000 (0:00:00.050) 0:01:55.200 ******* 2020-11-20T11:25:21.172 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:25:21.173 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:21.207 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:21 +0000 (0:00:00.040) 0:01:55.241 ******* 2020-11-20T11:25:21.461 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:25:21.463 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:21.547 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:21.665 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:25:21.666 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:25:21.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:21 +0000 (0:00:00.497) 0:01:55.739 ******* 2020-11-20T11:25:21.800 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:21.866 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.071 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.147 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.180 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.184 INFO:teuthology.task.ansible.out: 2020-11-20T11:25:22.409 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.497 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.552 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.730 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.839 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:22 +0000 (0:00:01.168) 0:01:56.908 ******* 2020-11-20T11:25:22.879 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:22.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:22 +0000 (0:00:00.043) 0:01:56.951 ******* 2020-11-20T11:25:23.054 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:23.082 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:25:23.084 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:25:23.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:23 +0000 (0:00:00.201) 0:01:57.153 ******* 2020-11-20T11:25:23.124 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:25:23.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:23 +0000 (0:00:00.043) 0:01:57.196 ******* 2020-11-20T11:25:23.351 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.373 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:25:23.375 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:25:23.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:23 +0000 (0:00:00.249) 0:01:57.446 ******* 2020-11-20T11:25:23.417 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:25:23.419 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.537 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.580 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.612 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:25:23.614 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:25:23.648 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:23 +0000 (0:00:00.237) 0:01:57.683 ******* 2020-11-20T11:25:23.741 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:25:23.743 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.764 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.860 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.925 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.939 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:23.941 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:23.975 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:23 +0000 (0:00:00.327) 0:01:58.010 ******* 2020-11-20T11:25:23.983 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:24.023 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.047) 0:01:58.058 ******* 2020-11-20T11:25:24.041 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:24.180 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:25:24.182 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:24.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.191) 0:01:58.249 ******* 2020-11-20T11:25:24.221 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:25:24.223 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:24.257 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.043) 0:01:58.292 ******* 2020-11-20T11:25:24.264 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T11:25:24.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.045) 0:01:58.337 ******* 2020-11-20T11:25:24.309 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T11:25:24.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.041) 0:01:58.379 ******* 2020-11-20T11:25:24.395 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:25:24.396 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:25:24.409 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:24.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.112) 0:01:58.491 ******* 2020-11-20T11:25:24.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:25:24.653 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:25:24.685 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.228) 0:01:58.720 ******* 2020-11-20T11:25:24.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:25:24.725 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T11:25:24.756 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.071) 0:01:58.791 ******* 2020-11-20T11:25:24.762 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:25:24.764 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:25:24.801 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:24 +0000 (0:00:00.045) 0:01:58.836 ******* 2020-11-20T11:25:25.044 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:25:25.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.276) 0:01:59.113 ******* 2020-11-20T11:25:25.252 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:25:25.253 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:25:25.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.207) 0:01:59.321 ******* 2020-11-20T11:25:25.324 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:25:25.326 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.081) 0:01:59.402 ******* 2020-11-20T11:25:25.395 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:25:25.397 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.065) 0:01:59.468 ******* 2020-11-20T11:25:25.440 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:25:25.442 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:25:25.478 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.045) 0:01:59.513 ******* 2020-11-20T11:25:25.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:25:25.486 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.046) 0:01:59.560 ******* 2020-11-20T11:25:25.532 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:25:25.534 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.591 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.066) 0:01:59.626 ******* 2020-11-20T11:25:25.600 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:25:25.601 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.636 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.044) 0:01:59.671 ******* 2020-11-20T11:25:25.642 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:25:25.644 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.041) 0:01:59.712 ******* 2020-11-20T11:25:25.683 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:25:25.684 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.039) 0:01:59.751 ******* 2020-11-20T11:25:25.722 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:25:25.724 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.050) 0:01:59.802 ******* 2020-11-20T11:25:25.775 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:25:25.776 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:25:25.777 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.050) 0:01:59.852 ******* 2020-11-20T11:25:25.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.036) 0:01:59.889 ******* 2020-11-20T11:25:25.860 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:25:25.863 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.052) 0:01:59.941 ******* 2020-11-20T11:25:25.949 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.043) 0:01:59.984 ******* 2020-11-20T11:25:25.955 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:25:25.957 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:25.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:25 +0000 (0:00:00.044) 0:02:00.029 ******* 2020-11-20T11:25:26.001 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:25:26.002 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.041) 0:02:00.071 ******* 2020-11-20T11:25:26.043 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:25:26.044 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.043) 0:02:00.115 ******* 2020-11-20T11:25:26.086 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:25:26.088 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.040) 0:02:00.155 ******* 2020-11-20T11:25:26.128 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:25:26.129 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.042) 0:02:00.197 ******* 2020-11-20T11:25:26.169 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:25:26.171 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.041) 0:02:00.239 ******* 2020-11-20T11:25:26.210 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:25:26.212 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.249 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.044) 0:02:00.283 ******* 2020-11-20T11:25:26.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.031) 0:02:00.315 ******* 2020-11-20T11:25:26.287 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:25:26.288 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.323 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.043) 0:02:00.358 ******* 2020-11-20T11:25:26.330 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.365 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.041) 0:02:00.400 ******* 2020-11-20T11:25:26.371 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:25:26.372 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.041) 0:02:00.441 ******* 2020-11-20T11:25:26.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.446 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.039) 0:02:00.481 ******* 2020-11-20T11:25:26.452 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:25:26.453 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.487 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.040) 0:02:00.522 ******* 2020-11-20T11:25:26.493 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:25:26.495 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.041) 0:02:00.563 ******* 2020-11-20T11:25:26.533 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:25:26.535 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.039) 0:02:00.603 ******* 2020-11-20T11:25:26.573 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:25:26.574 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.040) 0:02:00.643 ******* 2020-11-20T11:25:26.636 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.060) 0:02:00.703 ******* 2020-11-20T11:25:26.694 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:25:26.696 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.058) 0:02:00.762 ******* 2020-11-20T11:25:26.743 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:25:26.745 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:25:26.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.050) 0:02:00.813 ******* 2020-11-20T11:25:26.785 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:25:26.786 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.043) 0:02:00.856 ******* 2020-11-20T11:25:26.854 INFO:teuthology.task.ansible.out: 2020-11-20T11:25:26.856 INFO:teuthology.task.ansible.out:TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.066) 0:02:00.923 ******* 2020-11-20T11:25:26.916 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:25:26.918 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:26.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:26 +0000 (0:00:00.062) 0:02:00.985 ******* 2020-11-20T11:25:26.978 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.012 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.061) 0:02:01.047 ******* 2020-11-20T11:25:27.031 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:25:27.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.054) 0:02:01.101 ******* 2020-11-20T11:25:27.073 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:25:27.074 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.116 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.049) 0:02:01.151 ******* 2020-11-20T11:25:27.123 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:25:27.125 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:01 UTC", "ActiveEnterTimestampMonotonic": "15164980", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service ntpdate.service system.slice systemd-tmpfiles-setup.service sysinit.target -.mount systemd-journald.socket tmp.mount sntp.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:22:00 UTC", "AssertTimestampMonotonic": "14053835", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ConditionTimestampMonotonic": "14053809", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T11:25:27.126 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2412", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ExecMainStartTimestampMonotonic": "14202512", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:22:00 UTC", "InactiveExitTimestampMonotonic": "14075861", "InvocationID": "4d87413d15e543e2b3ae9ba974eee3af", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T11:25:27.128 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2412", "MemoryAccounting": "yes", "MemoryCurrent": "2789376", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T11:25:27.130 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:01 UTC", "StateChangeTimestampMonotonic": "15164980", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:00 UTC", "WatchdogTimestampMonotonic": "14202522", "WatchdogUSec": "0"}} 2020-11-20T11:25:27.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.045) 0:02:01.196 ******* 2020-11-20T11:25:27.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:27.191 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:25:27.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.060) 0:02:01.257 ******* 2020-11-20T11:25:27.265 INFO:teuthology.task.ansible.out: 2020-11-20T11:25:27.359 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} Friday 20 November 2020 11:25:27 +0000 (0:00:00.088) 0:02:01.345 ******* TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.070) 0:02:01.416 ******* 2020-11-20T11:25:27.389 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:25:27.390 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:10 UTC", "ActiveEnterTimestampMonotonic": "14791957", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount tmp.mount ntpd.service sntp.service systemd-tmpfiles-setup.service ntpdate.service systemd-journald.socket sysinit.target system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:22:08 UTC", "AssertTimestampMonotonic": "13639258", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:22:08 UTC", "ConditionTimestampMonotonic": "13639230", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T11:25:27.392 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2402", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:09 UTC", "ExecMainStartTimestampMonotonic": "13817178", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:22:08 UTC", "InactiveExitTimestampMonotonic": "13655238", "InvocationID": "95699cd054674bc8afc3781af655c9de", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T11:25:27.393 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2402", "MemoryAccounting": "yes", "MemoryCurrent": "2502656", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T11:25:27.395 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:10 UTC", "StateChangeTimestampMonotonic": "14791957", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:09 UTC", "WatchdogTimestampMonotonic": "13817187", "WatchdogUSec": "0"}} 2020-11-20T11:25:27.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.044) 0:02:01.460 ******* 2020-11-20T11:25:27.430 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:25:27.433 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.045) 0:02:01.505 ******* 2020-11-20T11:25:27.477 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:27.479 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:25:27.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.041) 0:02:01.547 ******* 2020-11-20T11:25:27.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:25:27.522 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.042) 0:02:01.590 ******* 2020-11-20T11:25:27.570 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:27.572 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:25:27.615 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.060) 0:02:01.650 ******* 2020-11-20T11:25:27.645 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.062) 0:02:01.712 ******* 2020-11-20T11:25:27.684 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:25:27.689 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:25:27.719 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.041) 0:02:01.754 ******* 2020-11-20T11:25:27.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:25:27.729 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.041) 0:02:01.796 ******* 2020-11-20T11:25:27.778 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:25:27.779 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:25:27.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:25:27.782 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:27.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.057) 0:02:01.853 ******* 2020-11-20T11:25:27.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:27 +0000 (0:00:00.031) 0:02:01.885 ******* 2020-11-20T11:25:28.019 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:25:28.021 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ActiveEnterTimestampMonotonic": "15660175", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target tmp.mount systemd-tmpfiles-setup.service systemd-journald.socket ntpdate.service ntpd.service system.slice -.mount sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:21:59 UTC", "AssertTimestampMonotonic": "14370155", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:21:59 UTC", "ConditionTimestampMonotonic": "14370124", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T11:25:28.022 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2421", "ExecMainStartTimestamp": "Fri 2020-11-20 11:22:00 UTC", "ExecMainStartTimestampMonotonic": "15574381", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:21:59 UTC", "InactiveExitTimestampMonotonic": "14405088", "InvocationID": "42425fae66a04a099a08d2aa1abd88fc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T11:25:28.024 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2421", "MemoryAccounting": "yes", "MemoryCurrent": "2596864", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T11:25:28.026 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:22:00 UTC", "StateChangeTimestampMonotonic": "15660175", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:22:00 UTC", "WatchdogTimestampMonotonic": "15574395", "WatchdogUSec": "0"}} 2020-11-20T11:25:28.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.207) 0:02:02.092 ******* 2020-11-20T11:25:28.063 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:25:28.065 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:25:28.106 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.048) 0:02:02.141 ******* 2020-11-20T11:25:28.113 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:28.115 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:25:28.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.044) 0:02:02.186 ******* 2020-11-20T11:25:28.200 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:25:28.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.081) 0:02:02.268 ******* 2020-11-20T11:25:28.260 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:28.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.064) 0:02:02.332 ******* 2020-11-20T11:25:28.315 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:25:28.317 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:25:28.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.068) 0:02:02.401 ******* 2020-11-20T11:25:28.374 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:25:28.375 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:28.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.043) 0:02:02.445 ******* 2020-11-20T11:25:28.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:25:28.439 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:28.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.060) 0:02:02.506 ******* 2020-11-20T11:25:28.588 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:25:28.590 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:25:28.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.152) 0:02:02.658 ******* 2020-11-20T11:25:28.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:25:28.668 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:25:28.702 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:28 +0000 (0:00:00.078) 0:02:02.737 ******* 2020-11-20T11:25:29.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:25:29.233 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:25:29.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.573) 0:02:03.310 ******* 2020-11-20T11:25:29.578 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:25:29.580 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:25:29.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.340) 0:02:03.651 ******* 2020-11-20T11:25:29.644 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:25:29.646 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:29.680 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.064) 0:02:03.715 ******* 2020-11-20T11:25:29.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:25:29.688 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:25:29.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.043) 0:02:03.758 ******* 2020-11-20T11:25:29.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:25:29.731 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:25:29.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.041) 0:02:03.800 ******* 2020-11-20T11:25:29.773 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:25:29.775 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:29.813 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.047) 0:02:03.848 ******* 2020-11-20T11:25:29.841 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:25:29.842 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:25:29.880 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.067) 0:02:03.915 ******* 2020-11-20T11:25:29.960 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:25:29.962 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:25:29.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:29 +0000 (0:00:00.116) 0:02:04.032 ******* 2020-11-20T11:25:30.027 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:25:30.029 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.064) 0:02:04.096 ******* 2020-11-20T11:25:30.068 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:25:30.069 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:25:30.102 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.040) 0:02:04.137 ******* 2020-11-20T11:25:30.111 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:25:30.113 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:25:30.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.043) 0:02:04.180 ******* 2020-11-20T11:25:30.152 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:25:30.153 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.041) 0:02:04.222 ******* 2020-11-20T11:25:30.193 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:25:30.195 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.041) 0:02:04.263 ******* 2020-11-20T11:25:30.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:25:30.236 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:25:30.270 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.042) 0:02:04.305 ******* 2020-11-20T11:25:30.297 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:25:30.299 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.061) 0:02:04.367 ******* 2020-11-20T11:25:30.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:25:30.350 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:25:30.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.060) 0:02:04.428 ******* 2020-11-20T11:25:30.434 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.436 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:25:30.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.077) 0:02:04.505 ******* 2020-11-20T11:25:30.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.033) 0:02:04.539 ******* 2020-11-20T11:25:30.533 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:25:30.535 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:25:30.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.063) 0:02:04.602 ******* 2020-11-20T11:25:30.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.031) 0:02:04.634 ******* 2020-11-20T11:25:30.691 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:25:30.693 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:25:30.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.131) 0:02:04.765 ******* 2020-11-20T11:25:30.760 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:25:30.762 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.066) 0:02:04.832 ******* 2020-11-20T11:25:30.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.034) 0:02:04.867 ******* 2020-11-20T11:25:30.839 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:25:30.841 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:25:30.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.049) 0:02:04.916 ******* 2020-11-20T11:25:30.888 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:25:30.890 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.890 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.892 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:30.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.047) 0:02:04.963 ******* 2020-11-20T11:25:30.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.032) 0:02:04.996 ******* 2020-11-20T11:25:30.967 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:25:30.969 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:30 +0000 (0:00:00.041) 0:02:05.037 ******* 2020-11-20T11:25:31.008 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:25:31.010 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.011 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditiona 2020-11-20T11:25:31.013 INFO:teuthology.task.ansible.out:l result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:25:31.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.052) 0:02:05.090 ******* 2020-11-20T11:25:31.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.034) 0:02:05.124 ******* 2020-11-20T11:25:31.096 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:25:31.098 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.099 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.101 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.061) 0:02:05.186 ******* 2020-11-20T11:25:31.183 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.031) 0:02:05.218 ******* 2020-11-20T11:25:31.189 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:25:31.191 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.227 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.044) 0:02:05.262 ******* 2020-11-20T11:25:31.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.054) 0:02:05.316 ******* 2020-11-20T11:25:31.292 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:25:31.295 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.296 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi105.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.298 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => ( 2020-11-20T11:25:31.301 INFO:teuthology.task.ansible.out:item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.072) 0:02:05.389 ******* 2020-11-20T11:25:31.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.052) 0:02:05.442 ******* 2020-11-20T11:25:31.414 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:25:31.415 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.461 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.053) 0:02:05.496 ******* 2020-11-20T11:25:31.469 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:31.471 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.050) 0:02:05.546 ******* 2020-11-20T11:25:31.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:25:31.519 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.044) 0:02:05.591 ******* 2020-11-20T11:25:31.588 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.031) 0:02:05.623 ******* 2020-11-20T11:25:31.595 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:25:31.597 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.050) 0:02:05.673 ******* 2020-11-20T11:25:31.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.031) 0:02:05.705 ******* 2020-11-20T11:25:31.676 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.043) 0:02:05.749 ******* 2020-11-20T11:25:31.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:25:31.722 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.043) 0:02:05.792 ******* 2020-11-20T11:25:31.763 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:25:31.765 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.040) 0:02:05.832 ******* 2020-11-20T11:25:31.804 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:25:31.805 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:25:31.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.042) 0:02:05.875 ******* 2020-11-20T11:25:31.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.032) 0:02:05.907 ******* 2020-11-20T11:25:31.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:25:31.880 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.042) 0:02:05.950 ******* 2020-11-20T11:25:31.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:31 +0000 (0:00:00.045) 0:02:05.995 ******* 2020-11-20T11:25:31.967 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:25:31.969 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:31.982 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.056) 0:02:06.052 ******* 2020-11-20T11:25:32.025 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.059) 0:02:06.111 ******* 2020-11-20T11:25:32.083 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:25:32.084 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005208", "end": "2020-11-20 11:25:31.993833", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:25:31.988625", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.085 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.085 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.085 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, 2020-11-20T11:25:32.087 INFO:teuthology.task.ansible.out: "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.054) 0:02:06.165 ******* 2020-11-20T11:25:32.138 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T11:25:32.140 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.045) 0:02:06.211 ******* 2020-11-20T11:25:32.182 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:25:32.183 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.044) 0:02:06.255 ******* 2020-11-20T11:25:32.227 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:25:32.228 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.041) 0:02:06.297 ******* 2020-11-20T11:25:32.269 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi067.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003292", "end": "2020-11-20 11:25:32.194362", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:25:32.191070", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:32.270 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.042) 0:02:06.339 ******* 2020-11-20T11:25:32.354 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:25:32.401 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.096) 0:02:06.436 ******* 2020-11-20T11:25:32.442 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:25:32.445 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi067.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002907", "end": "2020-11-20 11:25:32.391007", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:25:32.388100", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:25:32.532 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:25:32 +0000 (0:00:00.130) 0:02:06.567 ******* 2020-11-20T11:25:35.243 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:25:32 +0000 (0:00:00.094) 0:02:06.661 ******* TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:25:32 +0000 (0:00:00.082) 0:02:06.744 ******* TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi067.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026230", "end": "2020-11-20 11:25:32.633574", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:25:32.607344", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 11:25:32 +0000 (0:00:00.057) 0:02:06.801 ******* TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:25:32 +0000 (0:00:00.052) 0:02:06.853 ******* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Friday 20 November 2020 11:25:32 +0000 (0:00:00.066) 0:02:06.920 ******* TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:25:32 +0000 (0:00:00.060) 0:02:06.981 ******* TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-read 2020-11-20T11:25:35.245 INFO:teuthology.task.ansible.out:y", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi100.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004841", "end": "2020-11-20 11:25:33.135678", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:25:33.130837", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi100.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002915", "end": "2020-11-20 11:25:33.324151", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:25:33.321236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi105.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.005959", "end": "2020-11-20 11:25:33.454860", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:25:32.448901", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi100.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002808", "end": "2020-11-20 11:25:33.505833", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:25:33.503025", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} ok: [smithi105.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ans 2020-11-20T11:25:35.247 INFO:teuthology.task.ansible.out:ible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002890", "end": "2020-11-20 11:25:33.673391", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:25:33.670501", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi100.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016552", "end": "2020-11-20 11:25:33.716982", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:25:33.700430", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 11:25:33 +0000 (0:00:00.846) 0:02:07.828 ******* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Friday 20 November 2020 11:25:33 +0000 (0:00:00.080) 0:02:07.909 ******* TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi105.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002813", "end": "2020-11-20 11:25:33.855060", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:25:33.852247", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi105.front.sepia.ceph 2020-11-20T11:25:35.248 INFO:teuthology.task.ansible.out:.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028878", "end": "2020-11-20 11:25:34.084526", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:25:34.055648", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 11:25:34 +0000 (0:00:00.352) 0:02:08.261 ******* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Friday 20 November 2020 11:25:34 +0000 (0:00:00.061) 0:02:08.323 ******* TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi067.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 smithi100.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 smithi105.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 Friday 20 November 2020 11:25:34 +0000 (0:00:00.321) 0:02:08.645 ******* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 16.06s common : nrpe - Load SELinux policy pack 2020-11-20T11:25:35.250 INFO:teuthology.task.ansible.out:age ---------------------------- 15.75s testnode : Zap all non-root disks --------------------------------------- 7.39s common : Make sure smartmontools is installed --------------------------- 2.26s Gathering Facts --------------------------------------------------------- 1.54s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.54s testnode : Install packages --------------------------------------------- 1.39s testnode : Create logical volume(s) ------------------------------------- 1.17s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.85s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.79s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 0.73s Gathering Facts --------------------------------------------------------- 0.68s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.64s testnode : Create pip.conf and configure it to use our mirror ----------- 0.57s testnode : Rebuild rpmdb ------------------------------------------------ 0.57s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.57s testnode : Ensure ceph packages are not present. ------------------------ 0.55s common : nrpe - Ensure SELinux policy is up to date --------------------- 0.52s users : Create all admin users with sudo access. ------------------------ 0.52s common : nrpe - Install SELinux dependencies ---------------------------- 0.52s 2020-11-20T11:25:35.354 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2020-11-20T11:25:35.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:25:35.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:25:35.427 INFO:teuthology.orchestra.run.smithi105:> true 2020-11-20T11:25:35.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:25:35.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:25:35.589 INFO:teuthology.orchestra.run.smithi100:> true 2020-11-20T11:25:35.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:25:35.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:25:35.752 INFO:teuthology.orchestra.run.smithi067:> true 2020-11-20T11:25:35.843 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T11:25:35.854 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T11:25:35.855 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:25:35.855 INFO:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:25:35.896 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:25:35.915 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:25:35.956 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2020-11-20T11:25:35.969 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2020-11-20T11:25:35.987 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:25:36.005 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:25:36.064 INFO:teuthology.orchestra.run.smithi105.stderr:bash: ntpq: command not found 2020-11-20T11:25:36.067 INFO:teuthology.orchestra.run.smithi105.stdout:210 Number of sources = 4 2020-11-20T11:25:36.067 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:25:36.067 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2020-11-20T11:25:36.068 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.068 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.068 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.068 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.069 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:25:36.069 INFO:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:25:36.110 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:25:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:25:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2020-11-20T11:25:36.198 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2020-11-20T11:25:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:25:36.238 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:25:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2020-11-20T11:25:36.304 INFO:teuthology.orchestra.run.smithi100.stdout:210 Number of sources = 4 2020-11-20T11:25:36.305 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:25:36.305 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2020-11-20T11:25:36.305 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.305 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.306 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.306 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:25:36.306 INFO:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:25:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:25:36.375 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:25:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2020-11-20T11:25:36.450 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2020-11-20T11:25:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:25:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:25:36.566 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2020-11-20T11:25:36.569 INFO:teuthology.orchestra.run.smithi067.stdout:210 Number of sources = 4 2020-11-20T11:25:36.569 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:25:36.569 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2020-11-20T11:25:36.570 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.570 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.570 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.570 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:25:36.571 INFO:teuthology.run_tasks:Running task install... 2020-11-20T11:25:36.583 DEBUG:teuthology.task.install:project ceph 2020-11-20T11:25:36.584 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T11:25:36.584 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T11:25:36.585 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T11:25:36.591 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T11:25:36.592 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T11:25:36.592 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-11-20T11:25:36.632 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-11-20T11:25:36.633 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.634 INFO:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2020-11-20T11:25:36.634 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:25:36.635 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-11-20T11:25:36.678 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS 2020-11-20T11:25:36.679 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.680 INFO:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2020-11-20T11:25:36.680 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:25:36.681 INFO:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2020-11-20T11:25:36.711 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-11-20T11:25:36.712 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:25:36.721 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS 2020-11-20T11:25:36.722 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.722 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:25:36.723 INFO:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2020-11-20T11:25:36.762 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS 2020-11-20T11:25:36.763 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:25:36.805 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS 2020-11-20T11:25:36.807 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:25:36.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:25:36.875 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:25:36.876 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:25:36.930 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:25:36.930 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:25:36.964 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:25:36.964 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:25:37.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:25:37.191 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:25:37.191 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.206 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.220 INFO:teuthology.orchestra.run.smithi105.stderr:1+1 records in 2020-11-20T11:25:37.221 INFO:teuthology.orchestra.run.smithi105.stderr:1+1 records out 2020-11-20T11:25:37.221 INFO:teuthology.orchestra.run.smithi105.stderr:676 bytes copied, 4.1278e-05 s, 16.4 MB/s 2020-11-20T11:25:37.222 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:25:37.223 INFO:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:25:37.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:25:37.237 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:25:37.237 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:1+1 records in 2020-11-20T11:25:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:1+1 records out 2020-11-20T11:25:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:676 bytes copied, 4.0227e-05 s, 16.8 MB/s 2020-11-20T11:25:37.269 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:25:37.269 INFO:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:25:37.276 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:25:37.276 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:25:37.277 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:25:37.293 INFO:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:25:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+1 records in 2020-11-20T11:25:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+1 records out 2020-11-20T11:25:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:676 bytes copied, 4.3797e-05 s, 15.4 MB/s 2020-11-20T11:25:37.309 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:25:37.310 INFO:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:25:37.340 INFO:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:25:37.377 INFO:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:25:37.384 INFO:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:25:37.426 INFO:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:25:37.446 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2020-11-20T11:25:37.447 INFO:teuthology.orchestra.run.smithi105:> sudo yum clean all 2020-11-20T11:25:37.472 INFO:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:25:37.494 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2020-11-20T11:25:37.495 INFO:teuthology.orchestra.run.smithi100:> sudo yum clean all 2020-11-20T11:25:37.502 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2020-11-20T11:25:37.504 INFO:teuthology.orchestra.run.smithi067:> sudo yum clean all 2020-11-20T11:25:37.724 INFO:teuthology.orchestra.run.smithi105.stdout:42 files removed 2020-11-20T11:25:37.753 INFO:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:25:37.778 INFO:teuthology.orchestra.run.smithi100.stdout:42 files removed 2020-11-20T11:25:37.806 INFO:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:25:37.815 INFO:teuthology.orchestra.run.smithi067.stdout:42 files removed 2020-11-20T11:25:37.845 INFO:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:25:38.783 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 105 kB/s | 72 kB 00:00 2020-11-20T11:25:38.857 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 102 kB/s | 72 kB 00:00 2020-11-20T11:25:38.941 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 100 kB/s | 72 kB 00:00 2020-11-20T11:25:39.451 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 23 kB/s | 15 kB 00:00 2020-11-20T11:25:39.523 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 24 kB/s | 15 kB 00:00 2020-11-20T11:25:39.614 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 23 kB/s | 15 kB 00:00 2020-11-20T11:25:40.084 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 2.3 kB/s | 1.4 kB 00:00 2020-11-20T11:25:40.151 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 2.4 kB/s | 1.4 kB 00:00 2020-11-20T11:25:40.252 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - AppStream 48 MB/s | 7.0 MB 00:00 2020-11-20T11:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 2.3 kB/s | 1.4 kB 00:00 2020-11-20T11:25:40.338 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - AppStream 42 MB/s | 7.0 MB 00:00 2020-11-20T11:25:40.425 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - AppStream 47 MB/s | 7.0 MB 00:00 2020-11-20T11:25:41.451 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-11-20T11:25:41.548 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-11-20T11:25:41.685 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Base 23 MB/s | 2.2 MB 00:00 2020-11-20T11:25:41.875 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-11-20T11:25:41.982 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-11-20T11:25:42.144 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-11-20T11:25:42.351 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 20 MB/s | 8.3 MB 00:00 2020-11-20T11:25:42.401 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.3 MB 00:00 2020-11-20T11:25:42.577 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.3 MB 00:00 2020-11-20T11:25:44.076 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 4.7 MB/s | 23 kB 00:00 2020-11-20T11:25:44.119 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 5.3 MB/s | 23 kB 00:00 2020-11-20T11:25:44.476 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 4.7 MB/s | 23 kB 00:00 2020-11-20T11:25:44.978 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:44.978 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:44.982 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T11:25:44.982 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T11:25:44.983 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T11:25:44.983 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:25:44.984 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:25:44.985 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:25:44.985 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T11:25:45.018 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:45.019 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:45.022 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T11:25:45.023 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T11:25:45.023 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T11:25:45.024 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:25:45.027 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:25:45.027 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:25:45.027 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T11:25:45.120 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-11-20T11:25:45.142 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-11-20T11:25:45.143 INFO:teuthology.orchestra.run.smithi105.stdout: Package ArchVersion Repository Size 2020-11-20T11:25:45.143 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-11-20T11:25:45.143 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2020-11-20T11:25:45.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:25:45.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:25:45.146 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:25:45.146 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.146 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:25:45.147 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:25:45.148 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:25:45.149 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:25:45.149 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:25:45.149 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:25:45.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:25:45.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:25:45.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:25:45.150 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:25:45.150 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:25:45.151 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:25:45.151 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:25:45.151 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:25:45.151 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:25:45.151 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:25:45.152 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:25:45.152 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T11:25:45.152 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T11:25:45.152 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T11:25:45.152 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T11:25:45.153 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T11:25:45.153 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T11:25:45.153 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T11:25:45.153 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T11:25:45.154 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2020-11-20T11:25:45.154 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.154 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:25:45.154 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T11:25:45.154 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T11:25:45.155 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T11:25:45.155 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T11:25:45.155 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2020-11-20T11:25:45.155 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:25:45.155 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:25:45.156 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:25:45.156 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:25:45.156 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:25:45.156 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:25:45.156 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.157 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:25:45.157 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:25:45.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:25:45.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:25:45.158 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:25:45.158 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T11:25:45.158 INFO:teuthology.orchestra.run.smithi105.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T11:25:45.158 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T11:25:45.158 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T11:25:45.159 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T11:25:45.159 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T11:25:45.159 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T11:25:45.159 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T11:25:45.159 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T11:25:45.160 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.160 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T11:25:45.160 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T11:25:45.160 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T11:25:45.160 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T11:25:45.161 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T11:25:45.161 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T11:25:45.161 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T11:25:45.161 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T11:25:45.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T11:25:45.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T11:25:45.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T11:25:45.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T11:25:45.163 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T11:25:45.163 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T11:25:45.163 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T11:25:45.163 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T11:25:45.163 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T11:25:45.164 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T11:25:45.164 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T11:25:45.164 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T11:25:45.164 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T11:25:45.164 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T11:25:45.165 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T11:25:45.165 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T11:25:45.165 INFO:teuthology.orchestra.run.smithi105.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T11:25:45.165 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T11:25:45.165 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T11:25:45.166 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T11:25:45.166 INFO:teuthology.orchestra.run.smithi105.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T11:25:45.166 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T11:25:45.166 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T11:25:45.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T11:25:45.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T11:25:45.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T11:25:45.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T11:25:45.167 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T11:25:45.168 INFO:teuthology.orchestra.run.smithi105.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T11:25:45.168 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T11:25:45.168 INFO:teuthology.orchestra.run.smithi105.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T11:25:45.168 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T11:25:45.168 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T11:25:45.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T11:25:45.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T11:25:45.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T11:25:45.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T11:25:45.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T11:25:45.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T11:25:45.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T11:25:45.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T11:25:45.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T11:25:45.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T11:25:45.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T11:25:45.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T11:25:45.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T11:25:45.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T11:25:45.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T11:25:45.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T11:25:45.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T11:25:45.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T11:25:45.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T11:25:45.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T11:25:45.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T11:25:45.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T11:25:45.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T11:25:45.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T11:25:45.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T11:25:45.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T11:25:45.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T11:25:45.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T11:25:45.175 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T11:25:45.175 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T11:25:45.175 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2020-11-20T11:25:45.175 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T11:25:45.175 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T11:25:45.176 INFO:teuthology.orchestra.run.smithi105.stdout:Downgrading: 2020-11-20T11:25:45.176 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T11:25:45.176 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T11:25:45.176 INFO:teuthology.orchestra.run.smithi105.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T11:25:45.177 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T11:25:45.177 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T11:25:45.177 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:25:45.177 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2020-11-20T11:25:45.177 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-11-20T11:25:45.178 INFO:teuthology.orchestra.run.smithi105.stdout:Install 126 Packages 2020-11-20T11:25:45.178 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 6 Packages 2020-11-20T11:25:45.178 INFO:teuthology.orchestra.run.smithi105.stdout:Downgrade 5 Packages 2020-11-20T11:25:45.178 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:25:45.179 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-11-20T11:25:45.179 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 202 M 2020-11-20T11:25:45.180 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2020-11-20T11:25:45.186 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:45.186 INFO:teuthology.orchestra.run.smithi100.stdout: Package ArchVersion Repository Size 2020-11-20T11:25:45.187 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:45.187 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2020-11-20T11:25:45.187 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:25:45.187 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:25:45.187 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:25:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:25:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:25:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:25:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:25:45.189 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:25:45.189 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:25:45.189 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.189 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:25:45.190 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:25:45.190 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:25:45.190 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:25:45.190 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:25:45.190 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:25:45.191 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:25:45.191 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:25:45.191 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:25:45.191 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:25:45.191 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:25:45.192 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T11:25:45.192 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T11:25:45.192 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T11:25:45.192 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T11:25:45.192 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T11:25:45.193 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T11:25:45.193 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T11:25:45.193 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T11:25:45.193 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2020-11-20T11:25:45.193 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:25:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T11:25:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T11:25:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T11:25:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T11:25:45.195 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2020-11-20T11:25:45.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:25:45.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:25:45.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:25:45.196 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:25:45.196 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:25:45.196 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:25:45.196 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:25:45.197 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:25:45.197 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:25:45.197 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:25:45.197 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:25:45.197 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T11:25:45.198 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T11:25:45.198 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T11:25:45.198 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T11:25:45.198 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T11:25:45.198 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T11:25:45.199 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T11:25:45.199 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T11:25:45.199 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T11:25:45.199 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.199 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T11:25:45.200 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T11:25:45.200 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T11:25:45.200 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T11:25:45.200 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T11:25:45.201 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T11:25:45.201 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T11:25:45.201 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T11:25:45.201 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T11:25:45.201 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T11:25:45.202 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T11:25:45.202 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.202 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T11:25:45.202 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T11:25:45.202 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T11:25:45.203 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T11:25:45.203 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T11:25:45.203 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T11:25:45.203 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T11:25:45.203 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T11:25:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T11:25:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T11:25:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T11:25:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T11:25:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T11:25:45.205 INFO:teuthology.orchestra.run.smithi100.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T11:25:45.205 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T11:25:45.205 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T11:25:45.205 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T11:25:45.205 INFO:teuthology.orchestra.run.smithi100.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T11:25:45.206 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T11:25:45.206 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T11:25:45.206 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T11:25:45.206 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T11:25:45.206 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T11:25:45.207 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T11:25:45.207 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T11:25:45.207 INFO:teuthology.orchestra.run.smithi100.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T11:25:45.207 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T11:25:45.207 INFO:teuthology.orchestra.run.smithi100.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T11:25:45.208 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T11:25:45.208 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T11:25:45.208 INFO:teuthology.orchestra.run.smithi100.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T11:25:45.208 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T11:25:45.208 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T11:25:45.209 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T11:25:45.209 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T11:25:45.209 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T11:25:45.209 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T11:25:45.209 INFO:teuthology.orchestra.run.smithi100.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T11:25:45.210 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T11:25:45.210 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T11:25:45.210 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T11:25:45.210 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T11:25:45.211 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T11:25:45.211 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T11:25:45.211 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T11:25:45.211 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T11:25:45.211 INFO:teuthology.orchestra.run.smithi100.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T11:25:45.212 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T11:25:45.212 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T11:25:45.212 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T11:25:45.212 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T11:25:45.212 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T11:25:45.213 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T11:25:45.213 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T11:25:45.213 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T11:25:45.213 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T11:25:45.213 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T11:25:45.214 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T11:25:45.214 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T11:25:45.214 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T11:25:45.214 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2020-11-20T11:25:45.214 INFO:teuthology.orchestra.run.smithi100.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T11:25:45.215 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T11:25:45.215 INFO:teuthology.orchestra.run.smithi100.stdout:Downgrading: 2020-11-20T11:25:45.215 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T11:25:45.215 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T11:25:45.215 INFO:teuthology.orchestra.run.smithi100.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T11:25:45.216 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T11:25:45.216 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T11:25:45.216 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:25:45.216 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2020-11-20T11:25:45.216 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:45.217 INFO:teuthology.orchestra.run.smithi100.stdout:Install 126 Packages 2020-11-20T11:25:45.217 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 6 Packages 2020-11-20T11:25:45.217 INFO:teuthology.orchestra.run.smithi100.stdout:Downgrade 5 Packages 2020-11-20T11:25:45.217 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:25:45.218 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 202 M 2020-11-20T11:25:45.218 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2020-11-20T11:25:45.429 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:45.430 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T11:25:45.434 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T11:25:45.434 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T11:25:45.435 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:25:45.435 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:25:45.436 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:25:45.437 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T11:25:45.581 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2020-11-20T11:25:45.604 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:45.604 INFO:teuthology.orchestra.run.smithi067.stdout: Package ArchVersion Repository Size 2020-11-20T11:25:45.604 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:45.605 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2020-11-20T11:25:45.605 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:25:45.605 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:25:45.605 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:25:45.605 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.606 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:25:45.606 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:25:45.606 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:25:45.606 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:25:45.607 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:25:45.607 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:25:45.607 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:45.607 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:25:45.607 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:25:45.608 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:25:45.608 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:25:45.608 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:25:45.608 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:25:45.609 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:25:45.609 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:25:45.609 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:25:45.609 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:25:45.610 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:25:45.610 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T11:25:45.610 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T11:25:45.610 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T11:25:45.610 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T11:25:45.611 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T11:25:45.611 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T11:25:45.611 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T11:25:45.611 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T11:25:45.611 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2020-11-20T11:25:45.612 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.612 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:25:45.612 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T11:25:45.612 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T11:25:45.612 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T11:25:45.613 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T11:25:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2020-11-20T11:25:45.613 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:25:45.613 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:25:45.614 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:25:45.614 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:25:45.614 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:25:45.614 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:25:45.614 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:45.615 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:25:45.615 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:25:45.615 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:25:45.615 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:25:45.615 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:25:45.616 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T11:25:45.616 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T11:25:45.616 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T11:25:45.616 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T11:25:45.616 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T11:25:45.617 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T11:25:45.617 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T11:25:45.617 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T11:25:45.617 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T11:25:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T11:25:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T11:25:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T11:25:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T11:25:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T11:25:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T11:25:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T11:25:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T11:25:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T11:25:45.620 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T11:25:45.620 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T11:25:45.620 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T11:25:45.620 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T11:25:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T11:25:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T11:25:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T11:25:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T11:25:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T11:25:45.622 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T11:25:45.622 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T11:25:45.622 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T11:25:45.622 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T11:25:45.623 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T11:25:45.623 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T11:25:45.623 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T11:25:45.623 INFO:teuthology.orchestra.run.smithi067.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T11:25:45.623 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T11:25:45.624 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T11:25:45.624 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T11:25:45.624 INFO:teuthology.orchestra.run.smithi067.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T11:25:45.624 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T11:25:45.624 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T11:25:45.625 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T11:25:45.625 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T11:25:45.625 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T11:25:45.625 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T11:25:45.625 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T11:25:45.626 INFO:teuthology.orchestra.run.smithi067.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T11:25:45.626 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T11:25:45.626 INFO:teuthology.orchestra.run.smithi067.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T11:25:45.626 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T11:25:45.626 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T11:25:45.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T11:25:45.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T11:25:45.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T11:25:45.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T11:25:45.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T11:25:45.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T11:25:45.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T11:25:45.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T11:25:45.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T11:25:45.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T11:25:45.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T11:25:45.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T11:25:45.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T11:25:45.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T11:25:45.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T11:25:45.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T11:25:45.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T11:25:45.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T11:25:45.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T11:25:45.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T11:25:45.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T11:25:45.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T11:25:45.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T11:25:45.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T11:25:45.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T11:25:45.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T11:25:45.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T11:25:45.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T11:25:45.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T11:25:45.633 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T11:25:45.633 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2020-11-20T11:25:45.633 INFO:teuthology.orchestra.run.smithi067.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T11:25:45.633 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T11:25:45.634 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrading: 2020-11-20T11:25:45.634 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T11:25:45.634 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T11:25:45.634 INFO:teuthology.orchestra.run.smithi067.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T11:25:45.634 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T11:25:45.635 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T11:25:45.635 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:25:45.635 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2020-11-20T11:25:45.635 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:45.635 INFO:teuthology.orchestra.run.smithi067.stdout:Install 126 Packages 2020-11-20T11:25:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 6 Packages 2020-11-20T11:25:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrade 5 Packages 2020-11-20T11:25:45.636 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:25:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 202 M 2020-11-20T11:25:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2020-11-20T11:25:45.690 INFO:teuthology.orchestra.run.smithi105.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 1.6 MB/s | 851 kB 00:00 2020-11-20T11:25:45.699 INFO:teuthology.orchestra.run.smithi105.stdout:(2/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 79 MB/s | 686 kB 00:00 2020-11-20T11:25:45.719 INFO:teuthology.orchestra.run.smithi105.stdout:(3/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 75 MB/s | 1.5 MB 00:00 2020-11-20T11:25:45.728 INFO:teuthology.orchestra.run.smithi105.stdout:(4/137): krb5-workstation-1.17-9.el8.x86_64.rpm 1.6 MB/s | 940 kB 00:00 2020-11-20T11:25:45.784 INFO:teuthology.orchestra.run.smithi105.stdout:(5/137): libkadm5-1.17-9.el8.x86_64.rpm 295 kB/s | 184 kB 00:00 2020-11-20T11:25:46.103 INFO:teuthology.orchestra.run.smithi100.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 944 kB/s | 851 kB 00:00 2020-11-20T11:25:46.108 INFO:teuthology.orchestra.run.smithi100.stdout:(2/137): krb5-workstation-1.17-9.el8.x86_64.rpm 1.0 MB/s | 940 kB 00:00 2020-11-20T11:25:46.118 INFO:teuthology.orchestra.run.smithi100.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 47 MB/s | 686 kB 00:00 2020-11-20T11:25:46.131 INFO:teuthology.orchestra.run.smithi100.stdout:(4/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 64 MB/s | 1.5 MB 00:00 2020-11-20T11:25:46.395 INFO:teuthology.orchestra.run.smithi100.stdout:(5/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2020-11-20T11:25:46.580 INFO:teuthology.orchestra.run.smithi105.stdout:(6/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 7.5 kB/s | 6.4 kB 00:00 2020-11-20T11:25:47.092 INFO:teuthology.orchestra.run.smithi100.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 503 for https://download-cc-rdu01.fedoraproject.org/pub/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.109 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-libs-1.17-9.el8.x86_64.rpm: Status code: 503 for https://download-cc-rdu01.fedoraproject.org/pub/centos/8/BaseOS/x86_64/os/Packages/krb5-libs-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.111 INFO:teuthology.orchestra.run.smithi100.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 404 for http://mirror.linux.duke.edu/pub/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.118 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-workstation-1.17-9.el8.x86_64.rpm: Status code: 503 for https://download-cc-rdu01.fedoraproject.org/pub/centos/8/BaseOS/x86_64/os/Packages/krb5-workstation-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.119 INFO:teuthology.orchestra.run.smithi100.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 404 for http://packages.oit.ncsu.edu/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.120 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 503 for https://download-cc-rdu01.fedoraproject.org/pub/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.128 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-libs-1.17-9.el8.x86_64.rpm: Status code: 404 for http://mirror.linux.duke.edu/pub/centos/8/BaseOS/x86_64/os/Packages/krb5-libs-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.136 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-libs-1.17-9.el8.x86_64.rpm: Status code: 404 for http://packages.oit.ncsu.edu/centos/8/BaseOS/x86_64/os/Packages/krb5-libs-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.137 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-workstation-1.17-9.el8.x86_64.rpm: Status code: 404 for http://mirror.linux.duke.edu/pub/centos/8/BaseOS/x86_64/os/Packages/krb5-workstation-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.137 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 404 for http://mirror.linux.duke.edu/pub/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.140 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-workstation-1.17-9.el8.x86_64.rpm: Status code: 404 for http://packages.oit.ncsu.edu/centos/8/BaseOS/x86_64/os/Packages/krb5-workstation-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.146 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 404 for http://packages.oit.ncsu.edu/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.166 INFO:teuthology.orchestra.run.smithi100.stdout:[MIRROR] libkadm5-1.17-9.el8.x86_64.rpm: Status code: 404 for http://distro.ibiblio.org/centos/8/BaseOS/x86_64/os/Packages/libkadm5-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.166 INFO:teuthology.orchestra.run.smithi100.stdout:[FAILED] libkadm5-1.17-9.el8.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success 2020-11-20T11:25:47.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:25:47.172 INFO:teuthology.orchestra.run.smithi100.stdout:The downloaded packages were saved in cache until the next successful transaction. 2020-11-20T11:25:47.172 INFO:teuthology.orchestra.run.smithi100.stdout:You can remove cached packages by executing 'dnf clean packages'. 2020-11-20T11:25:47.174 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] krb5-libs-1.17-9.el8.x86_64.rpm: Status code: 404 for http://distro.ibiblio.org/centos/8/BaseOS/x86_64/os/Packages/krb5-libs-1.17-9.el8.x86_64.rpm 2020-11-20T11:25:47.174 INFO:teuthology.orchestra.run.smithi067.stdout:[FAILED] krb5-libs-1.17-9.el8.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success 2020-11-20T11:25:47.175 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:25:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:The downloaded packages were saved in cache until the next successful transaction. 2020-11-20T11:25:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:You can remove cached packages by executing 'dnf clean packages'. 2020-11-20T11:25:47.219 INFO:teuthology.orchestra.run.smithi067.stderr:Error: Error downloading packages: 2020-11-20T11:25:47.219 INFO:teuthology.orchestra.run.smithi067.stderr: Cannot download Packages/krb5-libs-1.17-9.el8.x86_64.rpm: All mirrors were tried 2020-11-20T11:25:47.233 INFO:teuthology.orchestra.run.smithi100.stderr:Error: Error downloading packages: 2020-11-20T11:25:47.234 INFO:teuthology.orchestra.run.smithi100.stderr: Cannot download Packages/libkadm5-1.17-9.el8.x86_64.rpm: All mirrors were tried 2020-11-20T11:25:47.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:25:47.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:25:48.140 INFO:teuthology.orchestra.run.smithi105.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 405 kB/s | 632 kB 00:01 2020-11-20T11:25:48.351 INFO:teuthology.orchestra.run.smithi105.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 965 kB/s | 204 kB 00:00 2020-11-20T11:25:49.467 INFO:teuthology.orchestra.run.smithi105.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.9 MB/s | 2.1 MB 00:01 2020-11-20T11:25:49.941 INFO:teuthology.orchestra.run.smithi105.stdout:(10/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 3.2 MB/s | 1.5 MB 00:00 2020-11-20T11:25:50.811 INFO:teuthology.orchestra.run.smithi105.stdout:(11/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 5.7 MB/s | 5.0 MB 00:00 2020-11-20T11:25:52.734 INFO:teuthology.orchestra.run.smithi105.stdout:(12/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 9.3 MB/s | 18 MB 00:01 2020-11-20T11:25:52.751 INFO:teuthology.orchestra.run.smithi105.stdout:(13/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 871 kB/s | 6.0 MB 00:07 2020-11-20T11:25:52.826 INFO:teuthology.orchestra.run.smithi105.stdout:(14/137): ceph-selinux-16.0.0-7397.gb86e691b.el 333 kB/s | 25 kB 00:00 2020-11-20T11:25:53.991 INFO:teuthology.orchestra.run.smithi105.stdout:(15/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 9.4 MB/s | 12 MB 00:01 2020-11-20T11:25:54.036 INFO:teuthology.orchestra.run.smithi105.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 549 kB/s | 24 kB 00:00 2020-11-20T11:25:54.103 INFO:teuthology.orchestra.run.smithi105.stdout:(17/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 8.1 MB/s | 562 kB 00:00 2020-11-20T11:25:54.156 INFO:teuthology.orchestra.run.smithi105.stdout:(18/137): librados-devel-16.0.0-7397.gb86e691b. 2.4 MB/s | 131 kB 00:00 2020-11-20T11:25:54.222 INFO:teuthology.orchestra.run.smithi105.stdout:(19/137): libradosstriper1-16.0.0-7397.gb86e691 7.2 MB/s | 486 kB 00:00 2020-11-20T11:25:54.598 INFO:teuthology.orchestra.run.smithi105.stdout:(20/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 9.9 MB/s | 3.7 MB 00:00 2020-11-20T11:25:54.651 INFO:teuthology.orchestra.run.smithi105.stdout:(21/137): python3-ceph-argparse-16.0.0-7397.gb8 758 kB/s | 40 kB 00:00 2020-11-20T11:25:54.705 INFO:teuthology.orchestra.run.smithi105.stdout:(22/137): python3-ceph-common-16.0.0-7397.gb86e 1.3 MB/s | 73 kB 00:00 2020-11-20T11:25:54.764 INFO:teuthology.orchestra.run.smithi105.stdout:(23/137): python3-cephfs-16.0.0-7397.gb86e691b. 3.4 MB/s | 204 kB 00:00 2020-11-20T11:25:54.831 INFO:teuthology.orchestra.run.smithi105.stdout:(24/137): python3-rados-16.0.0-7397.gb86e691b.e 5.5 MB/s | 375 kB 00:00 2020-11-20T11:25:54.897 INFO:teuthology.orchestra.run.smithi105.stdout:(25/137): python3-rbd-16.0.0-7397.gb86e691b.el8 5.2 MB/s | 353 kB 00:00 2020-11-20T11:25:54.947 INFO:teuthology.orchestra.run.smithi105.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 2.2 MB/s | 113 kB 00:00 2020-11-20T11:25:55.003 INFO:teuthology.orchestra.run.smithi105.stdout:(27/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.6 MB/s | 88 kB 00:00 2020-11-20T11:25:55.308 INFO:teuthology.orchestra.run.smithi105.stdout:(28/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 10 MB/s | 3.2 MB 00:00 2020-11-20T11:25:55.356 INFO:teuthology.orchestra.run.smithi105.stdout:(29/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.5 MB/s | 171 kB 00:00 2020-11-20T11:25:55.399 INFO:teuthology.orchestra.run.smithi105.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 560 kB/s | 24 kB 00:00 2020-11-20T11:25:55.444 INFO:teuthology.orchestra.run.smithi105.stdout:(31/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.5 MB/s | 66 kB 00:00 2020-11-20T11:25:55.734 INFO:teuthology.orchestra.run.smithi105.stdout:(32/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 11 MB/s | 3.2 MB 00:00 2020-11-20T11:25:56.539 INFO:teuthology.orchestra.run.smithi105.stdout:(33/137): ceph-mgr-diskprediction-local-16.0.0- 11 MB/s | 8.6 MB 00:00 2020-11-20T11:25:56.596 INFO:teuthology.orchestra.run.smithi105.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 3.4 MB/s | 198 kB 00:00 2020-11-20T11:25:56.646 INFO:teuthology.orchestra.run.smithi105.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 543 kB/s | 27 kB 00:00 2020-11-20T11:25:56.696 INFO:teuthology.orchestra.run.smithi105.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 177 kB/s | 8.8 kB 00:00 2020-11-20T11:25:56.748 INFO:teuthology.orchestra.run.smithi105.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.1 MB/s | 57 kB 00:00 2020-11-20T11:25:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2020-11-20T11:25:56.794 INFO:teuthology.orchestra.run.smithi105.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 78 MB/s | 688 kB 00:00 2020-11-20T11:25:56.798 INFO:teuthology.orchestra.run.smithi105.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 71 MB/s | 320 kB 00:00 2020-11-20T11:25:56.801 INFO:teuthology.orchestra.run.smithi105.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 57 MB/s | 161 kB 00:00 2020-11-20T11:25:56.806 INFO:teuthology.orchestra.run.smithi105.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 72 MB/s | 353 kB 00:00 2020-11-20T11:25:56.815 INFO:teuthology.orchestra.run.smithi105.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 78 MB/s | 709 kB 00:00 2020-11-20T11:25:56.819 INFO:teuthology.orchestra.run.smithi105.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-11-20T11:25:56.822 INFO:teuthology.orchestra.run.smithi105.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 61 MB/s | 188 kB 00:00 2020-11-20T11:25:56.873 INFO:teuthology.orchestra.run.smithi105.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 86 MB/s | 4.3 MB 00:00 2020-11-20T11:25:56.924 INFO:teuthology.orchestra.run.smithi105.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 86 MB/s | 4.4 MB 00:00 2020-11-20T11:25:56.980 INFO:teuthology.orchestra.run.smithi105.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 86 MB/s | 4.8 MB 00:00 2020-11-20T11:25:56.986 INFO:teuthology.orchestra.run.smithi105.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 35 MB/s | 214 kB 00:00 2020-11-20T11:25:56.993 INFO:teuthology.orchestra.run.smithi105.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 77 MB/s | 538 kB 00:00 2020-11-20T11:25:56.994 INFO:teuthology.orchestra.run.smithi105.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 25 MB/s | 27 kB 00:00 2020-11-20T11:25:56.996 INFO:teuthology.orchestra.run.smithi105.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 15 MB/s | 20 kB 00:00 2020-11-20T11:25:57.014 INFO:teuthology.orchestra.run.smithi105.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2020-11-20T11:25:57.017 INFO:teuthology.orchestra.run.smithi105.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 60 MB/s | 157 kB 00:00 2020-11-20T11:25:57.018 INFO:teuthology.orchestra.run.smithi105.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 35 MB/s | 39 kB 00:00 2020-11-20T11:25:57.062 INFO:teuthology.orchestra.run.smithi105.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 86 MB/s | 3.7 MB 00:00 2020-11-20T11:25:57.065 INFO:teuthology.orchestra.run.smithi105.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 63 MB/s | 225 kB 00:00 2020-11-20T11:25:57.067 INFO:teuthology.orchestra.run.smithi105.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 34 MB/s | 44 kB 00:00 2020-11-20T11:25:57.069 INFO:teuthology.orchestra.run.smithi105.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 57 MB/s | 126 kB 00:00 2020-11-20T11:25:57.071 INFO:teuthology.orchestra.run.smithi105.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 56 MB/s | 110 kB 00:00 2020-11-20T11:25:57.073 INFO:teuthology.orchestra.run.smithi105.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 39 MB/s | 54 kB 00:00 2020-11-20T11:25:57.277 INFO:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:25:57.287 INFO:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:25:57.316 INFO:teuthology.orchestra.run.smithi105.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 60 MB/s | 15 MB 00:00 2020-11-20T11:25:57.318 INFO:teuthology.orchestra.run.smithi105.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 17 MB/s | 27 kB 00:00 2020-11-20T11:25:57.324 INFO:teuthology.orchestra.run.smithi105.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 74 MB/s | 457 kB 00:00 2020-11-20T11:25:57.328 INFO:teuthology.orchestra.run.smithi105.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 69 MB/s | 298 kB 00:00 2020-11-20T11:25:57.330 INFO:teuthology.orchestra.run.smithi105.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 42 MB/s | 54 kB 00:00 2020-11-20T11:25:57.332 INFO:teuthology.orchestra.run.smithi105.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 49 MB/s | 82 kB 00:00 2020-11-20T11:25:57.333 INFO:teuthology.orchestra.run.smithi105.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 20 MB/s | 21 kB 00:00 2020-11-20T11:25:57.334 INFO:teuthology.orchestra.run.smithi105.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 36 MB/s | 48 kB 00:00 2020-11-20T11:25:57.341 INFO:teuthology.orchestra.run.smithi105.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 78 MB/s | 548 kB 00:00 2020-11-20T11:25:57.343 INFO:teuthology.orchestra.run.smithi105.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 16 MB/s | 19 kB 00:00 2020-11-20T11:25:57.344 INFO:teuthology.orchestra.run.smithi105.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 27 MB/s | 38 kB 00:00 2020-11-20T11:25:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 78 MB/s | 638 kB 00:00 2020-11-20T11:25:57.355 INFO:teuthology.orchestra.run.smithi105.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 61 MB/s | 169 kB 00:00 2020-11-20T11:25:57.357 INFO:teuthology.orchestra.run.smithi105.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 37 MB/s | 47 kB 00:00 2020-11-20T11:25:57.360 INFO:teuthology.orchestra.run.smithi105.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 66 MB/s | 199 kB 00:00 2020-11-20T11:25:57.361 INFO:teuthology.orchestra.run.smithi105.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 52 MB/s | 86 kB 00:00 2020-11-20T11:25:57.363 INFO:teuthology.orchestra.run.smithi105.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 54 MB/s | 95 kB 00:00 2020-11-20T11:25:57.364 INFO:teuthology.orchestra.run.smithi105.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-11-20T11:25:57.368 INFO:teuthology.orchestra.run.smithi105.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 69 MB/s | 249 kB 00:00 2020-11-20T11:25:57.395 INFO:teuthology.orchestra.run.smithi105.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 85 MB/s | 2.3 MB 00:00 2020-11-20T11:25:57.403 INFO:teuthology.orchestra.run.smithi105.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 78 MB/s | 605 kB 00:00 2020-11-20T11:25:57.406 INFO:teuthology.orchestra.run.smithi105.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 68 MB/s | 228 kB 00:00 2020-11-20T11:25:57.410 INFO:teuthology.orchestra.run.smithi105.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 67 MB/s | 220 kB 00:00 2020-11-20T11:25:57.413 INFO:teuthology.orchestra.run.smithi105.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 66 MB/s | 195 kB 00:00 2020-11-20T11:25:57.414 INFO:teuthology.orchestra.run.smithi105.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 32 MB/s | 43 kB 00:00 2020-11-20T11:25:57.417 INFO:teuthology.orchestra.run.smithi105.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 60 MB/s | 155 kB 00:00 2020-11-20T11:25:57.418 INFO:teuthology.orchestra.run.smithi105.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 25 MB/s | 34 kB 00:00 2020-11-20T11:25:57.421 INFO:teuthology.orchestra.run.smithi105.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 56 MB/s | 123 kB 00:00 2020-11-20T11:25:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 37 MB/s | 43 kB 00:00 2020-11-20T11:25:57.425 INFO:teuthology.orchestra.run.smithi105.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 62 MB/s | 176 kB 00:00 2020-11-20T11:25:57.427 INFO:teuthology.orchestra.run.smithi105.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 44 MB/s | 69 kB 00:00 2020-11-20T11:25:57.428 INFO:teuthology.orchestra.run.smithi105.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 43 MB/s | 56 kB 00:00 2020-11-20T11:25:57.526 INFO:teuthology.orchestra.run.smithi105.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:25:57.585 INFO:teuthology.orchestra.run.smithi105.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 5.3 MB/s | 315 kB 00:00 2020-11-20T11:25:57.606 INFO:teuthology.orchestra.run.smithi105.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 8.4 MB/s | 181 kB 00:00 2020-11-20T11:25:57.626 INFO:teuthology.orchestra.run.smithi105.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:25:57.646 INFO:teuthology.orchestra.run.smithi105.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:25:57.666 INFO:teuthology.orchestra.run.smithi105.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T11:25:57.686 INFO:teuthology.orchestra.run.smithi105.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.1 MB/s | 44 kB 00:00 2020-11-20T11:25:57.699 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Base 110 kB/s | 3.9 kB 00:00 2020-11-20T11:25:57.707 INFO:teuthology.orchestra.run.smithi105.stdout:(101/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.7 MB/s | 185 kB 00:00 2020-11-20T11:25:57.707 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Base 126 kB/s | 3.9 kB 00:00 2020-11-20T11:25:57.727 INFO:teuthology.orchestra.run.smithi105.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 1.6 MB/s | 33 kB 00:00 2020-11-20T11:25:57.747 INFO:teuthology.orchestra.run.smithi105.stdout:(103/137): python3-certifi-2018.10.15-7.el8.noa 823 kB/s | 16 kB 00:00 2020-11-20T11:25:57.768 INFO:teuthology.orchestra.run.smithi105.stdout:(104/137): python3-cheroot-8.2.1-1.el8.noarch.r 6.7 MB/s | 145 kB 00:00 2020-11-20T11:25:57.807 INFO:teuthology.orchestra.run.smithi105.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 9.5 MB/s | 384 kB 00:00 2020-11-20T11:25:57.946 INFO:teuthology.orchestra.run.smithi105.stdout:(106/137): ceph-common-16.0.0-7397.gb86e691b.el 1.9 MB/s | 23 MB 00:12 2020-11-20T11:25:57.947 INFO:teuthology.orchestra.run.smithi105.stdout:(107/137): python3-cssselect-0.9.2-10.el8.noarc 288 kB/s | 40 kB 00:00 2020-11-20T11:25:57.967 INFO:teuthology.orchestra.run.smithi105.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 3.9 MB/s | 81 kB 00:00 2020-11-20T11:25:57.987 INFO:teuthology.orchestra.run.smithi105.stdout:(109/137): python3-jaraco-6.2-6.el8.noarch.rpm 564 kB/s | 11 kB 00:00 2020-11-20T11:25:58.007 INFO:teuthology.orchestra.run.smithi105.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 897 kB/s | 18 kB 00:00 2020-11-20T11:25:58.044 INFO:teuthology.orchestra.run.smithi105.stdout:(111/137): python3-execnet-1.7.1-1.el8.noarch.r 3.6 MB/s | 355 kB 00:00 2020-11-20T11:25:58.048 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:58.048 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:58.052 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T11:25:58.053 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T11:25:58.053 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T11:25:58.054 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:25:58.054 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:25:58.055 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:25:58.056 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T11:25:58.060 INFO:teuthology.orchestra.run.smithi105.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.9 MB/s | 49 kB 00:00 2020-11-20T11:25:58.063 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:58.064 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:25:58.067 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T11:25:58.068 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T11:25:58.068 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T11:25:58.069 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:25:58.069 INFO:teuthology.orchestra.run.smithi105.stdout:(113/137): python3-kubernetes-11.0.0-2.el8.noar 19 MB/s | 1.2 MB 00:00 2020-11-20T11:25:58.070 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:25:58.070 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:25:58.071 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T11:25:58.077 INFO:teuthology.orchestra.run.smithi105.stdout:(114/137): python3-more-itertools-7.2.0-3.el8.n 3.5 MB/s | 59 kB 00:00 2020-11-20T11:25:58.090 INFO:teuthology.orchestra.run.smithi105.stdout:(115/137): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:25:58.093 INFO:teuthology.orchestra.run.smithi105.stdout:(116/137): python3-portend-2.6-1.el8.noarch.rpm 960 kB/s | 16 kB 00:00 2020-11-20T11:25:58.110 INFO:teuthology.orchestra.run.smithi105.stdout:(117/137): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T11:25:58.111 INFO:teuthology.orchestra.run.smithi105.stdout:(118/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.3 MB/s | 48 kB 00:00 2020-11-20T11:25:58.127 INFO:teuthology.orchestra.run.smithi105.stdout:(119/137): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-20T11:25:58.131 INFO:teuthology.orchestra.run.smithi105.stdout:(120/137): python3-routes-2.4.1-12.el8.noarch.r 9.1 MB/s | 196 kB 00:00 2020-11-20T11:25:58.144 INFO:teuthology.orchestra.run.smithi105.stdout:(121/137): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T11:25:58.151 INFO:teuthology.orchestra.run.smithi105.stdout:(122/137): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2020-11-20T11:25:58.161 INFO:teuthology.orchestra.run.smithi105.stdout:(123/137): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2020-11-20T11:25:58.171 INFO:teuthology.orchestra.run.smithi105.stdout:(124/137): python3-trustme-0.6.0-4.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2020-11-20T11:25:58.179 INFO:teuthology.orchestra.run.smithi105.stdout:(125/137): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-11-20T11:25:58.193 INFO:teuthology.orchestra.run.smithi105.stdout:(126/137): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-11-20T11:25:58.196 INFO:teuthology.orchestra.run.smithi105.stdout:(127/137): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T11:25:58.198 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2020-11-20T11:25:58.207 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-11-20T11:25:58.212 INFO:teuthology.orchestra.run.smithi105.stdout:(128/137): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-11-20T11:25:58.213 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:58.213 INFO:teuthology.orchestra.run.smithi067.stdout: Package ArchVersion Repository Size 2020-11-20T11:25:58.214 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:58.214 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2020-11-20T11:25:58.214 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:25:58.214 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:25:58.214 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:25:58.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:58.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:25:58.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:25:58.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:25:58.215 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:25:58.216 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:25:58.216 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:25:58.216 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:58.216 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:25:58.217 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:25:58.217 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:25:58.217 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:25:58.217 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:25:58.217 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:25:58.218 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:25:58.218 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:25:58.218 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:25:58.218 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:25:58.218 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:25:58.219 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T11:25:58.219 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T11:25:58.219 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T11:25:58.219 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T11:25:58.219 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T11:25:58.220 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T11:25:58.220 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T11:25:58.220 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T11:25:58.220 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2020-11-20T11:25:58.220 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:58.221 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:25:58.221 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T11:25:58.221 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T11:25:58.221 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T11:25:58.221 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T11:25:58.222 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2020-11-20T11:25:58.222 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:25:58.222 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:25:58.222 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:25:58.223 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:25:58.223 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:25:58.223 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:25:58.223 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:58.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:25:58.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:25:58.224 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:25:58.224 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:25:58.224 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:25:58.225 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T11:25:58.225 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T11:25:58.225 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T11:25:58.225 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T11:25:58.225 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T11:25:58.226 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T11:25:58.226 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T11:25:58.226 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T11:25:58.226 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T11:25:58.227 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T11:25:58.227 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T11:25:58.227 INFO:teuthology.orchestra.run.smithi067.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T11:25:58.227 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T11:25:58.227 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T11:25:58.228 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T11:25:58.228 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T11:25:58.228 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T11:25:58.228 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T11:25:58.229 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T11:25:58.229 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T11:25:58.229 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T11:25:58.229 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T11:25:58.229 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T11:25:58.230 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T11:25:58.230 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T11:25:58.230 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T11:25:58.230 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T11:25:58.230 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T11:25:58.231 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T11:25:58.231 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T11:25:58.231 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T11:25:58.231 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T11:25:58.231 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T11:25:58.232 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T11:25:58.232 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T11:25:58.232 INFO:teuthology.orchestra.run.smithi067.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T11:25:58.232 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T11:25:58.232 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T11:25:58.233 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T11:25:58.233 INFO:teuthology.orchestra.run.smithi067.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T11:25:58.233 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T11:25:58.233 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T11:25:58.233 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T11:25:58.234 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T11:25:58.234 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T11:25:58.234 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T11:25:58.234 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T11:25:58.234 INFO:teuthology.orchestra.run.smithi067.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T11:25:58.235 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T11:25:58.235 INFO:teuthology.orchestra.run.smithi067.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T11:25:58.235 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T11:25:58.236 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T11:25:58.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T11:25:58.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T11:25:58.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T11:25:58.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T11:25:58.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T11:25:58.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T11:25:58.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T11:25:58.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T11:25:58.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T11:25:58.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T11:25:58.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T11:25:58.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T11:25:58.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T11:25:58.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T11:25:58.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T11:25:58.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T11:25:58.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T11:25:58.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T11:25:58.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T11:25:58.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T11:25:58.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T11:25:58.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T11:25:58.241 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T11:25:58.241 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T11:25:58.241 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T11:25:58.241 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T11:25:58.241 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T11:25:58.242 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T11:25:58.242 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T11:25:58.242 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T11:25:58.242 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2020-11-20T11:25:58.242 INFO:teuthology.orchestra.run.smithi067.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T11:25:58.243 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T11:25:58.243 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrading: 2020-11-20T11:25:58.243 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T11:25:58.243 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T11:25:58.243 INFO:teuthology.orchestra.run.smithi067.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T11:25:58.244 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T11:25:58.244 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T11:25:58.244 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:25:58.244 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2020-11-20T11:25:58.244 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2020-11-20T11:25:58.245 INFO:teuthology.orchestra.run.smithi067.stdout:Install 126 Packages 2020-11-20T11:25:58.245 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 6 Packages 2020-11-20T11:25:58.245 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrade 5 Packages 2020-11-20T11:25:58.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:25:58.247 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:58.247 INFO:teuthology.orchestra.run.smithi100.stdout: Package ArchVersion Repository Size 2020-11-20T11:25:58.247 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:58.248 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2020-11-20T11:25:58.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:25:58.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:25:58.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:25:58.249 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:58.249 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:25:58.249 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:25:58.249 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:25:58.249 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:25:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:25:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:25:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:25:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:25:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:25:58.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:25:58.251 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:25:58.251 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:25:58.251 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:25:58.252 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:25:58.252 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:25:58.252 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:25:58.252 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:25:58.252 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:25:58.253 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T11:25:58.253 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T11:25:58.253 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T11:25:58.253 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T11:25:58.253 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T11:25:58.254 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T11:25:58.254 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T11:25:58.254 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T11:25:58.254 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2020-11-20T11:25:58.254 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:58.255 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:25:58.255 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T11:25:58.255 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T11:25:58.255 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T11:25:58.255 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T11:25:58.256 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2020-11-20T11:25:58.256 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:25:58.256 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:25:58.256 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:25:58.257 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:25:58.257 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:25:58.257 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:25:58.257 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:25:58.257 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:25:58.258 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:25:58.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:25:58.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:25:58.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:25:58.258 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T11:25:58.259 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T11:25:58.259 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T11:25:58.259 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T11:25:58.259 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T11:25:58.259 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T11:25:58.260 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T11:25:58.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T11:25:58.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T11:25:58.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T11:25:58.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T11:25:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T11:25:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T11:25:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T11:25:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T11:25:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T11:25:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T11:25:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T11:25:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T11:25:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T11:25:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T11:25:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T11:25:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T11:25:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T11:25:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T11:25:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T11:25:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T11:25:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T11:25:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T11:25:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T11:25:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T11:25:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T11:25:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T11:25:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T11:25:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T11:25:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T11:25:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T11:25:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T11:25:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T11:25:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T11:25:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T11:25:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T11:25:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T11:25:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T11:25:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T11:25:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T11:25:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T11:25:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T11:25:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T11:25:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T11:25:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T11:25:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T11:25:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T11:25:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T11:25:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T11:25:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T11:25:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T11:25:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T11:25:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T11:25:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T11:25:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T11:25:58.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T11:25:58.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T11:25:58.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T11:25:58.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T11:25:58.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T11:25:58.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T11:25:58.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T11:25:58.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T11:25:58.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T11:25:58.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T11:25:58.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T11:25:58.278 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T11:25:58.278 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T11:25:58.278 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T11:25:58.279 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T11:25:58.279 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T11:25:58.280 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T11:25:58.280 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T11:25:58.281 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T11:25:58.281 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T11:25:58.282 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T11:25:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2020-11-20T11:25:58.283 INFO:teuthology.orchestra.run.smithi100.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T11:25:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T11:25:58.335 INFO:teuthology.orchestra.run.smithi100.stdout:Downgrading: 2020-11-20T11:25:58.335 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T11:25:58.336 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T11:25:58.336 INFO:teuthology.orchestra.run.smithi100.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T11:25:58.337 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T11:25:58.337 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T11:25:58.338 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:25:58.338 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2020-11-20T11:25:58.339 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-11-20T11:25:58.339 INFO:teuthology.orchestra.run.smithi100.stdout:Install 126 Packages 2020-11-20T11:25:58.340 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 6 Packages 2020-11-20T11:25:58.341 INFO:teuthology.orchestra.run.smithi100.stdout:Downgrade 5 Packages 2020-11-20T11:25:58.341 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:25:58.342 INFO:teuthology.orchestra.run.smithi100.stdout:Total size: 202 M 2020-11-20T11:25:58.342 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 198 M 2020-11-20T11:25:58.343 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2020-11-20T11:25:58.343 INFO:teuthology.orchestra.run.smithi100.stdout:[SKIPPED] krb5-libs-1.17-9.el8.x86_64.rpm: Already downloaded 2020-11-20T11:25:58.343 INFO:teuthology.orchestra.run.smithi100.stdout:[SKIPPED] krb5-workstation-1.17-9.el8.x86_64.rpm: Already downloaded 2020-11-20T11:25:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:[SKIPPED] openssl-1.1.1c-2.el8_1.1.x86_64.rpm: Already downloaded 2020-11-20T11:25:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:[SKIPPED] openssl-libs-1.1.1c-2.el8_1.1.x86_64.rpm: Already downloaded 2020-11-20T11:25:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:[SKIPPED] ceph-16.0.0-7397.gb86e691b.el8.x86_64.rpm: Already downloaded 2020-11-20T11:25:58.345 INFO:teuthology.orchestra.run.smithi105.stdout:(129/137): python3-webtest-2.0.33-1.el8.noarch. 4.2 MB/s | 85 kB 00:00 2020-11-20T11:25:58.346 INFO:teuthology.orchestra.run.smithi105.stdout:(130/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.1 MB/s | 69 kB 00:00 2020-11-20T11:25:58.347 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 202 M 2020-11-20T11:25:58.347 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2020-11-20T11:25:58.353 INFO:teuthology.orchestra.run.smithi100.stdout:(6/137): libkadm5-1.17-9.el8.x86_64.rpm 4.2 MB/s | 184 kB 00:00 2020-11-20T11:25:58.354 INFO:teuthology.orchestra.run.smithi067.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 21 MB/s | 851 kB 00:00 2020-11-20T11:25:58.354 INFO:teuthology.orchestra.run.smithi067.stdout:(2/137): libkadm5-1.17-9.el8.x86_64.rpm 3.6 MB/s | 184 kB 00:00 2020-11-20T11:25:58.355 INFO:teuthology.orchestra.run.smithi067.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 51 MB/s | 686 kB 00:00 2020-11-20T11:25:58.355 INFO:teuthology.orchestra.run.smithi067.stdout:(4/137): krb5-workstation-1.17-9.el8.x86_64.rpm 15 MB/s | 940 kB 00:00 2020-11-20T11:25:58.356 INFO:teuthology.orchestra.run.smithi067.stdout:(5/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 54 MB/s | 1.5 MB 00:00 2020-11-20T11:25:58.460 INFO:teuthology.orchestra.run.smithi067.stdout:(6/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2020-11-20T11:25:58.520 INFO:teuthology.orchestra.run.smithi105.stdout:(131/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 8.3 MB/s | 2.4 MB 00:00 2020-11-20T11:25:58.545 INFO:teuthology.orchestra.run.smithi105.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 83 MB/s | 2.1 MB 00:00 2020-11-20T11:25:58.565 INFO:teuthology.orchestra.run.smithi105.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 84 MB/s | 1.7 MB 00:00 2020-11-20T11:25:58.567 INFO:teuthology.orchestra.run.smithi105.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 57 MB/s | 133 kB 00:00 2020-11-20T11:25:58.572 INFO:teuthology.orchestra.run.smithi105.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 63 MB/s | 308 kB 00:00 2020-11-20T11:25:58.828 INFO:teuthology.orchestra.run.smithi105.stdout:(136/137): librados2-16.0.0-7397.gb86e691b.el8. 6.0 MB/s | 3.7 MB 00:00 2020-11-20T11:25:59.169 INFO:teuthology.orchestra.run.smithi100.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 719 kB/s | 632 kB 00:00 2020-11-20T11:25:59.230 INFO:teuthology.orchestra.run.smithi067.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 822 kB/s | 632 kB 00:00 2020-11-20T11:25:59.388 INFO:teuthology.orchestra.run.smithi100.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 933 kB/s | 204 kB 00:00 2020-11-20T11:25:59.453 INFO:teuthology.orchestra.run.smithi067.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 913 kB/s | 204 kB 00:00 2020-11-20T11:26:01.212 INFO:teuthology.orchestra.run.smithi067.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.2 MB/s | 2.1 MB 00:01 2020-11-20T11:26:01.217 INFO:teuthology.orchestra.run.smithi100.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.2 MB/s | 2.1 MB 00:01 2020-11-20T11:26:02.378 INFO:teuthology.orchestra.run.smithi067.stdout:(10/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 1.3 MB/s | 1.5 MB 00:01 2020-11-20T11:26:02.693 INFO:teuthology.orchestra.run.smithi100.stdout:(10/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 1.0 MB/s | 1.5 MB 00:01 2020-11-20T11:26:02.993 INFO:teuthology.orchestra.run.smithi100.stdout:(11/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 1.3 MB/s | 6.0 MB 00:04 2020-11-20T11:26:03.023 INFO:teuthology.orchestra.run.smithi067.stdout:(11/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 1.3 MB/s | 6.0 MB 00:04 2020-11-20T11:26:05.054 INFO:teuthology.orchestra.run.smithi100.stdout:(12/137): ceph-common-16.0.0-7397.gb86e691b.el8 3.4 MB/s | 23 MB 00:06 2020-11-20T11:26:05.863 INFO:teuthology.orchestra.run.smithi067.stdout:(12/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 1.4 MB/s | 5.0 MB 00:03 2020-11-20T11:26:06.099 INFO:teuthology.orchestra.run.smithi067.stdout:(13/137): ceph-common-16.0.0-7397.gb86e691b.el8 2.9 MB/s | 23 MB 00:07 2020-11-20T11:26:06.167 INFO:teuthology.orchestra.run.smithi067.stdout:(14/137): ceph-selinux-16.0.0-7397.gb86e691b.el 366 kB/s | 25 kB 00:00 2020-11-20T11:26:07.287 INFO:teuthology.orchestra.run.smithi100.stdout:(13/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 1.1 MB/s | 5.0 MB 00:04 2020-11-20T11:26:07.361 INFO:teuthology.orchestra.run.smithi100.stdout:(14/137): ceph-selinux-16.0.0-7397.gb86e691b.el 334 kB/s | 25 kB 00:00 2020-11-20T11:26:08.485 INFO:teuthology.orchestra.run.smithi100.stdout:(15/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 3.4 MB/s | 12 MB 00:03 2020-11-20T11:26:08.561 INFO:teuthology.orchestra.run.smithi100.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 313 kB/s | 24 kB 00:00 2020-11-20T11:26:08.878 INFO:teuthology.orchestra.run.smithi100.stdout:(17/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 1.7 MB/s | 562 kB 00:00 2020-11-20T11:26:08.956 INFO:teuthology.orchestra.run.smithi100.stdout:(18/137): librados-devel-16.0.0-7397.gb86e691b. 1.6 MB/s | 131 kB 00:00 2020-11-20T11:26:09.184 INFO:teuthology.orchestra.run.smithi100.stdout:(19/137): libradosstriper1-16.0.0-7397.gb86e691 2.1 MB/s | 486 kB 00:00 2020-11-20T11:26:10.649 INFO:teuthology.orchestra.run.smithi100.stdout:(20/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 2.5 MB/s | 3.7 MB 00:01 2020-11-20T11:26:10.720 INFO:teuthology.orchestra.run.smithi100.stdout:(21/137): python3-ceph-argparse-16.0.0-7397.gb8 561 kB/s | 40 kB 00:00 2020-11-20T11:26:10.797 INFO:teuthology.orchestra.run.smithi100.stdout:(22/137): python3-ceph-common-16.0.0-7397.gb86e 1.0 MB/s | 73 kB 00:00 2020-11-20T11:26:10.869 INFO:teuthology.orchestra.run.smithi100.stdout:(23/137): python3-cephfs-16.0.0-7397.gb86e691b. 2.6 MB/s | 204 kB 00:00 2020-11-20T11:26:11.025 INFO:teuthology.orchestra.run.smithi100.stdout:(24/137): python3-rados-16.0.0-7397.gb86e691b.e 2.3 MB/s | 375 kB 00:00 2020-11-20T11:26:11.185 INFO:teuthology.orchestra.run.smithi100.stdout:(25/137): python3-rbd-16.0.0-7397.gb86e691b.el8 2.2 MB/s | 353 kB 00:00 2020-11-20T11:26:11.263 INFO:teuthology.orchestra.run.smithi100.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 1.4 MB/s | 113 kB 00:00 2020-11-20T11:26:11.341 INFO:teuthology.orchestra.run.smithi100.stdout:(27/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.1 MB/s | 88 kB 00:00 2020-11-20T11:26:11.893 INFO:teuthology.orchestra.run.smithi067.stdout:(15/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 2.0 MB/s | 12 MB 00:06 2020-11-20T11:26:11.963 INFO:teuthology.orchestra.run.smithi067.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 342 kB/s | 24 kB 00:00 2020-11-20T11:26:12.131 INFO:teuthology.orchestra.run.smithi067.stdout:(17/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.0 MB/s | 18 MB 00:09 2020-11-20T11:26:12.205 INFO:teuthology.orchestra.run.smithi067.stdout:(18/137): librados-devel-16.0.0-7397.gb86e691b. 1.7 MB/s | 131 kB 00:00 2020-11-20T11:26:12.360 INFO:teuthology.orchestra.run.smithi067.stdout:(19/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 1.4 MB/s | 562 kB 00:00 2020-11-20T11:26:12.426 INFO:teuthology.orchestra.run.smithi067.stdout:(20/137): libradosstriper1-16.0.0-7397.gb86e691 2.2 MB/s | 486 kB 00:00 2020-11-20T11:26:12.495 INFO:teuthology.orchestra.run.smithi067.stdout:(21/137): python3-ceph-argparse-16.0.0-7397.gb8 577 kB/s | 40 kB 00:00 2020-11-20T11:26:12.562 INFO:teuthology.orchestra.run.smithi067.stdout:(22/137): python3-ceph-common-16.0.0-7397.gb86e 1.1 MB/s | 73 kB 00:00 2020-11-20T11:26:12.640 INFO:teuthology.orchestra.run.smithi067.stdout:(23/137): python3-cephfs-16.0.0-7397.gb86e691b. 2.6 MB/s | 204 kB 00:00 2020-11-20T11:26:12.710 INFO:teuthology.orchestra.run.smithi100.stdout:(28/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 2.3 MB/s | 3.2 MB 00:01 2020-11-20T11:26:12.776 INFO:teuthology.orchestra.run.smithi067.stdout:(24/137): python3-rados-16.0.0-7397.gb86e691b.e 2.7 MB/s | 375 kB 00:00 2020-11-20T11:26:12.842 INFO:teuthology.orchestra.run.smithi100.stdout:(29/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 1.3 MB/s | 171 kB 00:00 2020-11-20T11:26:12.914 INFO:teuthology.orchestra.run.smithi100.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 337 kB/s | 24 kB 00:00 2020-11-20T11:26:12.918 INFO:teuthology.orchestra.run.smithi067.stdout:(25/137): python3-rbd-16.0.0-7397.gb86e691b.el8 2.4 MB/s | 353 kB 00:00 2020-11-20T11:26:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:(31/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 910 kB/s | 66 kB 00:00 2020-11-20T11:26:12.992 INFO:teuthology.orchestra.run.smithi067.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 1.5 MB/s | 113 kB 00:00 2020-11-20T11:26:13.064 INFO:teuthology.orchestra.run.smithi067.stdout:(27/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.2 MB/s | 88 kB 00:00 2020-11-20T11:26:14.389 INFO:teuthology.orchestra.run.smithi100.stdout:(32/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 2.3 MB/s | 3.2 MB 00:01 2020-11-20T11:26:14.395 INFO:teuthology.orchestra.run.smithi067.stdout:(28/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 2.4 MB/s | 3.2 MB 00:01 2020-11-20T11:26:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:(29/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 1.8 MB/s | 3.7 MB 00:02 2020-11-20T11:26:14.478 INFO:teuthology.orchestra.run.smithi067.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 347 kB/s | 24 kB 00:00 2020-11-20T11:26:14.529 INFO:teuthology.orchestra.run.smithi067.stdout:(31/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 1.3 MB/s | 171 kB 00:00 2020-11-20T11:26:14.544 INFO:teuthology.orchestra.run.smithi067.stdout:(32/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.0 MB/s | 66 kB 00:00 2020-11-20T11:26:15.288 INFO:teuthology.orchestra.run.smithi100.stdout:(33/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 1.5 MB/s | 18 MB 00:12 2020-11-20T11:26:15.569 INFO:teuthology.orchestra.run.smithi100.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 1.2 MB/s | 198 kB 00:00 2020-11-20T11:26:15.569 INFO:teuthology.orchestra.run.smithi100.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 358 kB/s | 27 kB 00:00 2020-11-20T11:26:15.601 INFO:teuthology.orchestra.run.smithi100.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 120 kB/s | 8.8 kB 00:00 2020-11-20T11:26:15.672 INFO:teuthology.orchestra.run.smithi100.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 808 kB/s | 57 kB 00:00 2020-11-20T11:26:15.711 INFO:teuthology.orchestra.run.smithi100.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-11-20T11:26:15.720 INFO:teuthology.orchestra.run.smithi100.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 74 MB/s | 688 kB 00:00 2020-11-20T11:26:15.724 INFO:teuthology.orchestra.run.smithi100.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 71 MB/s | 320 kB 00:00 2020-11-20T11:26:15.727 INFO:teuthology.orchestra.run.smithi100.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-11-20T11:26:15.732 INFO:teuthology.orchestra.run.smithi100.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 71 MB/s | 353 kB 00:00 2020-11-20T11:26:15.741 INFO:teuthology.orchestra.run.smithi100.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 76 MB/s | 709 kB 00:00 2020-11-20T11:26:15.745 INFO:teuthology.orchestra.run.smithi100.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-11-20T11:26:15.748 INFO:teuthology.orchestra.run.smithi100.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 63 MB/s | 188 kB 00:00 2020-11-20T11:26:15.801 INFO:teuthology.orchestra.run.smithi100.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 82 MB/s | 4.3 MB 00:00 2020-11-20T11:26:15.854 INFO:teuthology.orchestra.run.smithi100.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 82 MB/s | 4.4 MB 00:00 2020-11-20T11:26:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 83 MB/s | 4.8 MB 00:00 2020-11-20T11:26:15.915 INFO:teuthology.orchestra.run.smithi100.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 67 MB/s | 214 kB 00:00 2020-11-20T11:26:15.923 INFO:teuthology.orchestra.run.smithi100.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 75 MB/s | 538 kB 00:00 2020-11-20T11:26:15.924 INFO:teuthology.orchestra.run.smithi100.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 26 MB/s | 27 kB 00:00 2020-11-20T11:26:15.925 INFO:teuthology.orchestra.run.smithi100.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-11-20T11:26:15.944 INFO:teuthology.orchestra.run.smithi100.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 83 MB/s | 1.5 MB 00:00 2020-11-20T11:26:15.946 INFO:teuthology.orchestra.run.smithi100.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2020-11-20T11:26:15.947 INFO:teuthology.orchestra.run.smithi100.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 33 MB/s | 39 kB 00:00 2020-11-20T11:26:15.994 INFO:teuthology.orchestra.run.smithi100.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 83 MB/s | 3.7 MB 00:00 2020-11-20T11:26:15.996 INFO:teuthology.orchestra.run.smithi100.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 63 MB/s | 225 kB 00:00 2020-11-20T11:26:15.998 INFO:teuthology.orchestra.run.smithi100.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 32 MB/s | 44 kB 00:00 2020-11-20T11:26:16.000 INFO:teuthology.orchestra.run.smithi100.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 60 MB/s | 126 kB 00:00 2020-11-20T11:26:16.002 INFO:teuthology.orchestra.run.smithi100.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 57 MB/s | 110 kB 00:00 2020-11-20T11:26:16.004 INFO:teuthology.orchestra.run.smithi100.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2020-11-20T11:26:16.102 INFO:teuthology.orchestra.run.smithi067.stdout:(33/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 2.0 MB/s | 3.2 MB 00:01 2020-11-20T11:26:16.223 INFO:teuthology.orchestra.run.smithi100.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 66 MB/s | 15 MB 00:00 2020-11-20T11:26:16.225 INFO:teuthology.orchestra.run.smithi100.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 20 MB/s | 27 kB 00:00 2020-11-20T11:26:16.231 INFO:teuthology.orchestra.run.smithi100.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 75 MB/s | 457 kB 00:00 2020-11-20T11:26:16.234 INFO:teuthology.orchestra.run.smithi067.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 1.5 MB/s | 198 kB 00:00 2020-11-20T11:26:16.235 INFO:teuthology.orchestra.run.smithi100.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 72 MB/s | 298 kB 00:00 2020-11-20T11:26:16.237 INFO:teuthology.orchestra.run.smithi100.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 41 MB/s | 54 kB 00:00 2020-11-20T11:26:16.238 INFO:teuthology.orchestra.run.smithi100.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 50 MB/s | 82 kB 00:00 2020-11-20T11:26:16.257 INFO:teuthology.orchestra.run.smithi100.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 1.2 MB/s | 21 kB 00:00 2020-11-20T11:26:16.257 INFO:teuthology.orchestra.run.smithi100.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 38 MB/s | 48 kB 00:00 2020-11-20T11:26:16.264 INFO:teuthology.orchestra.run.smithi100.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 79 MB/s | 548 kB 00:00 2020-11-20T11:26:16.265 INFO:teuthology.orchestra.run.smithi100.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2020-11-20T11:26:16.266 INFO:teuthology.orchestra.run.smithi100.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 34 MB/s | 38 kB 00:00 2020-11-20T11:26:16.274 INFO:teuthology.orchestra.run.smithi100.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 80 MB/s | 638 kB 00:00 2020-11-20T11:26:16.277 INFO:teuthology.orchestra.run.smithi100.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 64 MB/s | 169 kB 00:00 2020-11-20T11:26:16.278 INFO:teuthology.orchestra.run.smithi100.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2020-11-20T11:26:16.281 INFO:teuthology.orchestra.run.smithi100.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 68 MB/s | 199 kB 00:00 2020-11-20T11:26:16.284 INFO:teuthology.orchestra.run.smithi100.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 39 MB/s | 86 kB 00:00 2020-11-20T11:26:16.286 INFO:teuthology.orchestra.run.smithi100.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 51 MB/s | 95 kB 00:00 2020-11-20T11:26:16.287 INFO:teuthology.orchestra.run.smithi100.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-11-20T11:26:16.291 INFO:teuthology.orchestra.run.smithi100.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 70 MB/s | 249 kB 00:00 2020-11-20T11:26:16.300 INFO:teuthology.orchestra.run.smithi067.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 413 kB/s | 27 kB 00:00 2020-11-20T11:26:16.318 INFO:teuthology.orchestra.run.smithi100.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 85 MB/s | 2.3 MB 00:00 2020-11-20T11:26:16.325 INFO:teuthology.orchestra.run.smithi100.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 78 MB/s | 605 kB 00:00 2020-11-20T11:26:16.329 INFO:teuthology.orchestra.run.smithi100.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 69 MB/s | 228 kB 00:00 2020-11-20T11:26:16.332 INFO:teuthology.orchestra.run.smithi100.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 70 MB/s | 220 kB 00:00 2020-11-20T11:26:16.335 INFO:teuthology.orchestra.run.smithi100.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 64 MB/s | 195 kB 00:00 2020-11-20T11:26:16.337 INFO:teuthology.orchestra.run.smithi100.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 36 MB/s | 43 kB 00:00 2020-11-20T11:26:16.339 INFO:teuthology.orchestra.run.smithi100.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 63 MB/s | 155 kB 00:00 2020-11-20T11:26:16.340 INFO:teuthology.orchestra.run.smithi100.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 32 MB/s | 34 kB 00:00 2020-11-20T11:26:16.342 INFO:teuthology.orchestra.run.smithi100.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 58 MB/s | 123 kB 00:00 2020-11-20T11:26:16.344 INFO:teuthology.orchestra.run.smithi100.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 37 MB/s | 43 kB 00:00 2020-11-20T11:26:16.346 INFO:teuthology.orchestra.run.smithi100.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 66 MB/s | 176 kB 00:00 2020-11-20T11:26:16.348 INFO:teuthology.orchestra.run.smithi100.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 47 MB/s | 69 kB 00:00 2020-11-20T11:26:16.349 INFO:teuthology.orchestra.run.smithi100.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 43 MB/s | 56 kB 00:00 2020-11-20T11:26:16.366 INFO:teuthology.orchestra.run.smithi067.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 135 kB/s | 8.8 kB 00:00 2020-11-20T11:26:16.431 INFO:teuthology.orchestra.run.smithi100.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T11:26:16.432 INFO:teuthology.orchestra.run.smithi067.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 863 kB/s | 57 kB 00:00 2020-11-20T11:26:16.464 INFO:teuthology.orchestra.run.smithi100.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 9.3 MB/s | 315 kB 00:00 2020-11-20T11:26:16.474 INFO:teuthology.orchestra.run.smithi067.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-11-20T11:26:16.480 INFO:teuthology.orchestra.run.smithi067.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 74 MB/s | 688 kB 00:00 2020-11-20T11:26:16.482 INFO:teuthology.orchestra.run.smithi100.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T11:26:16.485 INFO:teuthology.orchestra.run.smithi067.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 68 MB/s | 320 kB 00:00 2020-11-20T11:26:16.488 INFO:teuthology.orchestra.run.smithi067.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-11-20T11:26:16.493 INFO:teuthology.orchestra.run.smithi067.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 68 MB/s | 353 kB 00:00 2020-11-20T11:26:16.498 INFO:teuthology.orchestra.run.smithi100.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T11:26:16.506 INFO:teuthology.orchestra.run.smithi067.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 57 MB/s | 709 kB 00:00 2020-11-20T11:26:16.509 INFO:teuthology.orchestra.run.smithi067.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 65 MB/s | 259 kB 00:00 2020-11-20T11:26:16.513 INFO:teuthology.orchestra.run.smithi067.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 61 MB/s | 188 kB 00:00 2020-11-20T11:26:16.516 INFO:teuthology.orchestra.run.smithi100.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T11:26:16.533 INFO:teuthology.orchestra.run.smithi100.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.2 MB/s | 21 kB 00:00 2020-11-20T11:26:16.553 INFO:teuthology.orchestra.run.smithi100.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.5 MB/s | 44 kB 00:00 2020-11-20T11:26:16.567 INFO:teuthology.orchestra.run.smithi100.stdout:(101/137): python3-beautifulsoup4-4.6.3-2.el8.1 10 MB/s | 185 kB 00:00 2020-11-20T11:26:16.573 INFO:teuthology.orchestra.run.smithi067.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 72 MB/s | 4.3 MB 00:00 2020-11-20T11:26:16.584 INFO:teuthology.orchestra.run.smithi100.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-11-20T11:26:16.601 INFO:teuthology.orchestra.run.smithi100.stdout:(103/137): python3-certifi-2018.10.15-7.el8.noa 995 kB/s | 16 kB 00:00 2020-11-20T11:26:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:(104/137): python3-cheroot-8.2.1-1.el8.noarch.r 8.2 MB/s | 145 kB 00:00 2020-11-20T11:26:16.632 INFO:teuthology.orchestra.run.smithi067.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 74 MB/s | 4.4 MB 00:00 2020-11-20T11:26:16.651 INFO:teuthology.orchestra.run.smithi100.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 11 MB/s | 384 kB 00:00 2020-11-20T11:26:16.668 INFO:teuthology.orchestra.run.smithi100.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.4 MB/s | 40 kB 00:00 2020-11-20T11:26:16.686 INFO:teuthology.orchestra.run.smithi100.stdout:(107/137): python3-execnet-1.7.1-1.el8.noarch.r 19 MB/s | 355 kB 00:00 2020-11-20T11:26:16.696 INFO:teuthology.orchestra.run.smithi067.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 76 MB/s | 4.8 MB 00:00 2020-11-20T11:26:16.700 INFO:teuthology.orchestra.run.smithi067.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 57 MB/s | 214 kB 00:00 2020-11-20T11:26:16.703 INFO:teuthology.orchestra.run.smithi100.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 4.7 MB/s | 81 kB 00:00 2020-11-20T11:26:16.708 INFO:teuthology.orchestra.run.smithi067.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 64 MB/s | 538 kB 00:00 2020-11-20T11:26:16.709 INFO:teuthology.orchestra.run.smithi067.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 19 MB/s | 27 kB 00:00 2020-11-20T11:26:16.711 INFO:teuthology.orchestra.run.smithi067.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 15 MB/s | 20 kB 00:00 2020-11-20T11:26:16.719 INFO:teuthology.orchestra.run.smithi100.stdout:(109/137): python3-jaraco-6.2-6.el8.noarch.rpm 687 kB/s | 11 kB 00:00 2020-11-20T11:26:16.732 INFO:teuthology.orchestra.run.smithi067.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 72 MB/s | 1.5 MB 00:00 2020-11-20T11:26:16.736 INFO:teuthology.orchestra.run.smithi100.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 1.1 MB/s | 18 kB 00:00 2020-11-20T11:26:16.736 INFO:teuthology.orchestra.run.smithi067.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 36 MB/s | 157 kB 00:00 2020-11-20T11:26:16.739 INFO:teuthology.orchestra.run.smithi067.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 14 MB/s | 39 kB 00:00 2020-11-20T11:26:16.788 INFO:teuthology.orchestra.run.smithi100.stdout:(111/137): python3-kubernetes-11.0.0-2.el8.noar 23 MB/s | 1.2 MB 00:00 2020-11-20T11:26:16.788 INFO:teuthology.orchestra.run.smithi067.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 77 MB/s | 3.7 MB 00:00 2020-11-20T11:26:16.795 INFO:teuthology.orchestra.run.smithi067.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 40 MB/s | 225 kB 00:00 2020-11-20T11:26:16.797 INFO:teuthology.orchestra.run.smithi067.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 13 MB/s | 44 kB 00:00 2020-11-20T11:26:16.801 INFO:teuthology.orchestra.run.smithi067.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 29 MB/s | 126 kB 00:00 2020-11-20T11:26:16.804 INFO:teuthology.orchestra.run.smithi100.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.9 MB/s | 49 kB 00:00 2020-11-20T11:26:16.806 INFO:teuthology.orchestra.run.smithi067.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 27 MB/s | 110 kB 00:00 2020-11-20T11:26:16.810 INFO:teuthology.orchestra.run.smithi067.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 15 MB/s | 54 kB 00:00 2020-11-20T11:26:16.821 INFO:teuthology.orchestra.run.smithi100.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 3.4 MB/s | 59 kB 00:00 2020-11-20T11:26:16.840 INFO:teuthology.orchestra.run.smithi100.stdout:(114/137): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-11-20T11:26:16.857 INFO:teuthology.orchestra.run.smithi100.stdout:(115/137): python3-portend-2.6-1.el8.noarch.rpm 949 kB/s | 16 kB 00:00 2020-11-20T11:26:16.873 INFO:teuthology.orchestra.run.smithi100.stdout:(116/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.8 MB/s | 48 kB 00:00 2020-11-20T11:26:16.894 INFO:teuthology.orchestra.run.smithi100.stdout:(117/137): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T11:26:16.908 INFO:teuthology.orchestra.run.smithi100.stdout:(118/137): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2020-11-20T11:26:16.925 INFO:teuthology.orchestra.run.smithi100.stdout:(119/137): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-20T11:26:16.941 INFO:teuthology.orchestra.run.smithi100.stdout:(120/137): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T11:26:16.958 INFO:teuthology.orchestra.run.smithi100.stdout:(121/137): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-11-20T11:26:16.975 INFO:teuthology.orchestra.run.smithi100.stdout:(122/137): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2020-11-20T11:26:16.991 INFO:teuthology.orchestra.run.smithi100.stdout:(123/137): python3-trustme-0.6.0-4.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2020-11-20T11:26:17.010 INFO:teuthology.orchestra.run.smithi100.stdout:(124/137): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-11-20T11:26:17.027 INFO:teuthology.orchestra.run.smithi100.stdout:(125/137): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-11-20T11:26:17.044 INFO:teuthology.orchestra.run.smithi100.stdout:(126/137): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T11:26:17.061 INFO:teuthology.orchestra.run.smithi100.stdout:(127/137): python3-webtest-2.0.33-1.el8.noarch. 5.0 MB/s | 85 kB 00:00 2020-11-20T11:26:17.078 INFO:teuthology.orchestra.run.smithi067.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 54 MB/s | 15 MB 00:00 2020-11-20T11:26:17.078 INFO:teuthology.orchestra.run.smithi100.stdout:(128/137): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-11-20T11:26:17.082 INFO:teuthology.orchestra.run.smithi067.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 7.0 MB/s | 27 kB 00:00 2020-11-20T11:26:17.093 INFO:teuthology.orchestra.run.smithi067.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 40 MB/s | 457 kB 00:00 2020-11-20T11:26:17.095 INFO:teuthology.orchestra.run.smithi100.stdout:(129/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.0 MB/s | 69 kB 00:00 2020-11-20T11:26:17.102 INFO:teuthology.orchestra.run.smithi067.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 34 MB/s | 298 kB 00:00 2020-11-20T11:26:17.108 INFO:teuthology.orchestra.run.smithi067.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 10 MB/s | 54 kB 00:00 2020-11-20T11:26:17.114 INFO:teuthology.orchestra.run.smithi067.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 12 MB/s | 82 kB 00:00 2020-11-20T11:26:17.120 INFO:teuthology.orchestra.run.smithi067.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 3.8 MB/s | 21 kB 00:00 2020-11-20T11:26:17.121 INFO:teuthology.orchestra.run.smithi067.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 31 MB/s | 48 kB 00:00 2020-11-20T11:26:17.129 INFO:teuthology.orchestra.run.smithi067.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 75 MB/s | 548 kB 00:00 2020-11-20T11:26:17.133 INFO:teuthology.orchestra.run.smithi067.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 17 MB/s | 19 kB 00:00 2020-11-20T11:26:17.134 INFO:teuthology.orchestra.run.smithi067.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 25 MB/s | 38 kB 00:00 2020-11-20T11:26:17.140 INFO:teuthology.orchestra.run.smithi067.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 77 MB/s | 638 kB 00:00 2020-11-20T11:26:17.143 INFO:teuthology.orchestra.run.smithi067.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 62 MB/s | 169 kB 00:00 2020-11-20T11:26:17.144 INFO:teuthology.orchestra.run.smithi067.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 37 MB/s | 47 kB 00:00 2020-11-20T11:26:17.149 INFO:teuthology.orchestra.run.smithi067.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 45 MB/s | 199 kB 00:00 2020-11-20T11:26:17.150 INFO:teuthology.orchestra.run.smithi067.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 47 MB/s | 86 kB 00:00 2020-11-20T11:26:17.153 INFO:teuthology.orchestra.run.smithi067.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 50 MB/s | 95 kB 00:00 2020-11-20T11:26:17.155 INFO:teuthology.orchestra.run.smithi067.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 7.2 MB/s | 18 kB 00:00 2020-11-20T11:26:17.164 INFO:teuthology.orchestra.run.smithi067.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 28 MB/s | 249 kB 00:00 2020-11-20T11:26:17.209 INFO:teuthology.orchestra.run.smithi067.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 51 MB/s | 2.3 MB 00:00 2020-11-20T11:26:17.224 INFO:teuthology.orchestra.run.smithi067.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 40 MB/s | 605 kB 00:00 2020-11-20T11:26:17.234 INFO:teuthology.orchestra.run.smithi067.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 23 MB/s | 228 kB 00:00 2020-11-20T11:26:17.245 INFO:teuthology.orchestra.run.smithi067.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 21 MB/s | 220 kB 00:00 2020-11-20T11:26:17.254 INFO:teuthology.orchestra.run.smithi067.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 19 MB/s | 195 kB 00:00 2020-11-20T11:26:17.263 INFO:teuthology.orchestra.run.smithi067.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 5.2 MB/s | 43 kB 00:00 2020-11-20T11:26:17.273 INFO:teuthology.orchestra.run.smithi067.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 15 MB/s | 155 kB 00:00 2020-11-20T11:26:17.281 INFO:teuthology.orchestra.run.smithi067.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 4.1 MB/s | 34 kB 00:00 2020-11-20T11:26:17.291 INFO:teuthology.orchestra.run.smithi067.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 13 MB/s | 123 kB 00:00 2020-11-20T11:26:17.300 INFO:teuthology.orchestra.run.smithi067.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 4.6 MB/s | 43 kB 00:00 2020-11-20T11:26:17.311 INFO:teuthology.orchestra.run.smithi067.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 15 MB/s | 176 kB 00:00 2020-11-20T11:26:17.321 INFO:teuthology.orchestra.run.smithi067.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 7.0 MB/s | 69 kB 00:00 2020-11-20T11:26:17.323 INFO:teuthology.orchestra.run.smithi067.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 21 MB/s | 56 kB 00:00 2020-11-20T11:26:17.422 INFO:teuthology.orchestra.run.smithi067.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:26:17.462 INFO:teuthology.orchestra.run.smithi067.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2020-11-20T11:26:17.483 INFO:teuthology.orchestra.run.smithi067.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:26:17.503 INFO:teuthology.orchestra.run.smithi067.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:26:17.523 INFO:teuthology.orchestra.run.smithi067.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:26:17.543 INFO:teuthology.orchestra.run.smithi067.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:26:17.565 INFO:teuthology.orchestra.run.smithi067.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.0 MB/s | 44 kB 00:00 2020-11-20T11:26:17.585 INFO:teuthology.orchestra.run.smithi067.stdout:(101/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.6 MB/s | 185 kB 00:00 2020-11-20T11:26:17.605 INFO:teuthology.orchestra.run.smithi067.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 1.6 MB/s | 33 kB 00:00 2020-11-20T11:26:17.625 INFO:teuthology.orchestra.run.smithi067.stdout:(103/137): python3-certifi-2018.10.15-7.el8.noa 828 kB/s | 16 kB 00:00 2020-11-20T11:26:17.646 INFO:teuthology.orchestra.run.smithi067.stdout:(104/137): python3-cheroot-8.2.1-1.el8.noarch.r 6.8 MB/s | 145 kB 00:00 2020-11-20T11:26:17.686 INFO:teuthology.orchestra.run.smithi067.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 9.6 MB/s | 384 kB 00:00 2020-11-20T11:26:17.706 INFO:teuthology.orchestra.run.smithi067.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-11-20T11:26:17.713 INFO:teuthology.orchestra.run.smithi100.stdout:(130/137): ceph-mgr-diskprediction-local-16.0.0 2.6 MB/s | 8.6 MB 00:03 2020-11-20T11:26:17.728 INFO:teuthology.orchestra.run.smithi067.stdout:(107/137): python3-execnet-1.7.1-1.el8.noarch.r 16 MB/s | 355 kB 00:00 2020-11-20T11:26:17.752 INFO:teuthology.orchestra.run.smithi067.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 3.4 MB/s | 81 kB 00:00 2020-11-20T11:26:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:(109/137): python3-jaraco-6.2-6.el8.noarch.rpm 572 kB/s | 11 kB 00:00 2020-11-20T11:26:17.790 INFO:teuthology.orchestra.run.smithi067.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 886 kB/s | 18 kB 00:00 2020-11-20T11:26:17.853 INFO:teuthology.orchestra.run.smithi067.stdout:(111/137): python3-kubernetes-11.0.0-2.el8.noar 19 MB/s | 1.2 MB 00:00 2020-11-20T11:26:17.873 INFO:teuthology.orchestra.run.smithi067.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.4 MB/s | 49 kB 00:00 2020-11-20T11:26:17.893 INFO:teuthology.orchestra.run.smithi067.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 2.9 MB/s | 59 kB 00:00 2020-11-20T11:26:17.915 INFO:teuthology.orchestra.run.smithi067.stdout:(114/137): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:26:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:(115/137): python3-portend-2.6-1.el8.noarch.rpm 794 kB/s | 16 kB 00:00 2020-11-20T11:26:17.954 INFO:teuthology.orchestra.run.smithi067.stdout:(116/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.4 MB/s | 48 kB 00:00 2020-11-20T11:26:17.974 INFO:teuthology.orchestra.run.smithi067.stdout:(117/137): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2020-11-20T11:26:17.995 INFO:teuthology.orchestra.run.smithi067.stdout:(118/137): python3-routes-2.4.1-12.el8.noarch.r 9.3 MB/s | 196 kB 00:00 2020-11-20T11:26:18.016 INFO:teuthology.orchestra.run.smithi067.stdout:(119/137): python3-rsa-3.4.2-15.el8.noarch.rpm 3.5 MB/s | 73 kB 00:00 2020-11-20T11:26:18.036 INFO:teuthology.orchestra.run.smithi067.stdout:(120/137): python3-simplegeneric-0.8.1-17.el8.n 942 kB/s | 19 kB 00:00 2020-11-20T11:26:18.057 INFO:teuthology.orchestra.run.smithi067.stdout:(121/137): python3-singledispatch-3.4.0.3-18.el 1.1 MB/s | 24 kB 00:00 2020-11-20T11:26:18.077 INFO:teuthology.orchestra.run.smithi067.stdout:(122/137): python3-tempora-1.14.1-5.el8.noarch. 1.4 MB/s | 29 kB 00:00 2020-11-20T11:26:18.097 INFO:teuthology.orchestra.run.smithi067.stdout:(123/137): python3-trustme-0.6.0-4.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2020-11-20T11:26:18.119 INFO:teuthology.orchestra.run.smithi067.stdout:(124/137): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-11-20T11:26:18.140 INFO:teuthology.orchestra.run.smithi067.stdout:(125/137): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-11-20T11:26:18.160 INFO:teuthology.orchestra.run.smithi067.stdout:(126/137): python3-websocket-client-0.56.0-5.el 3.0 MB/s | 61 kB 00:00 2020-11-20T11:26:18.181 INFO:teuthology.orchestra.run.smithi067.stdout:(127/137): python3-webtest-2.0.33-1.el8.noarch. 4.1 MB/s | 85 kB 00:00 2020-11-20T11:26:18.202 INFO:teuthology.orchestra.run.smithi067.stdout:(128/137): python3-zc-lockfile-2.0-2.el8.noarch 1.0 MB/s | 23 kB 00:00 2020-11-20T11:26:18.223 INFO:teuthology.orchestra.run.smithi067.stdout:(129/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.3 MB/s | 69 kB 00:00 2020-11-20T11:26:18.698 INFO:teuthology.orchestra.run.smithi100.stdout:(131/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 2.4 MB/s | 2.4 MB 00:00 2020-11-20T11:26:18.735 INFO:teuthology.orchestra.run.smithi100.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 58 MB/s | 2.1 MB 00:00 2020-11-20T11:26:18.770 INFO:teuthology.orchestra.run.smithi100.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 49 MB/s | 1.7 MB 00:00 2020-11-20T11:26:18.782 INFO:teuthology.orchestra.run.smithi100.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 11 MB/s | 133 kB 00:00 2020-11-20T11:26:18.790 INFO:teuthology.orchestra.run.smithi100.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 36 MB/s | 308 kB 00:00 2020-11-20T11:26:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:(136/137): librados2-16.0.0-7397.gb86e691b.el8. 1.7 MB/s | 3.7 MB 00:02 2020-11-20T11:26:19.443 INFO:teuthology.orchestra.run.smithi067.stdout:(130/137): ceph-mgr-diskprediction-local-16.0.0 1.8 MB/s | 8.6 MB 00:04 2020-11-20T11:26:21.350 INFO:teuthology.orchestra.run.smithi067.stdout:(131/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 1.3 MB/s | 2.4 MB 00:01 2020-11-20T11:26:21.377 INFO:teuthology.orchestra.run.smithi067.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 80 MB/s | 2.1 MB 00:00 2020-11-20T11:26:21.398 INFO:teuthology.orchestra.run.smithi067.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 82 MB/s | 1.7 MB 00:00 2020-11-20T11:26:21.401 INFO:teuthology.orchestra.run.smithi067.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 53 MB/s | 133 kB 00:00 2020-11-20T11:26:21.405 INFO:teuthology.orchestra.run.smithi067.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 67 MB/s | 308 kB 00:00 2020-11-20T11:26:22.003 INFO:teuthology.orchestra.run.smithi067.stdout:(136/137): librados2-16.0.0-7397.gb86e691b.el8. 1.0 MB/s | 3.7 MB 00:03 2020-11-20T11:26:32.338 INFO:teuthology.orchestra.run.smithi105.stdout:(137/137): ceph-test-16.0.0-7397.gb86e691b.el8. 1.2 MB/s | 48 MB 00:39 2020-11-20T11:26:32.340 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:26:32.341 INFO:teuthology.orchestra.run.smithi105.stdout:Total 4.3 MB/s | 202 MB 00:47 2020-11-20T11:26:32.404 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2020-11-20T11:26:32.571 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2020-11-20T11:26:32.571 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2020-11-20T11:26:34.085 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2020-11-20T11:26:34.086 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2020-11-20T11:26:38.337 INFO:teuthology.orchestra.run.smithi100.stdout:(137/137): ceph-test-16.0.0-7397.gb86e691b.el8. 1.5 MB/s | 48 MB 00:30 2020-11-20T11:26:38.341 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:26:38.341 INFO:teuthology.orchestra.run.smithi100.stdout:Total 4.9 MB/s | 198 MB 00:40 2020-11-20T11:26:38.402 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2020-11-20T11:26:38.571 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2020-11-20T11:26:38.572 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2020-11-20T11:26:39.024 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2020-11-20T11:26:39.224 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T11:26:39.437 INFO:teuthology.orchestra.run.smithi105.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:39.494 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:39.632 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T11:26:39.760 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T11:26:39.934 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T11:26:40.044 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:40.084 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2020-11-20T11:26:40.085 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2020-11-20T11:26:40.119 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:40.293 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T11:26:40.476 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:40.496 INFO:teuthology.orchestra.run.smithi067.stdout:(137/137): ceph-test-16.0.0-7397.gb86e691b.el8. 1.4 MB/s | 48 MB 00:34 2020-11-20T11:26:40.500 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:26:40.501 INFO:teuthology.orchestra.run.smithi067.stdout:Total 4.8 MB/s | 202 MB 00:42 2020-11-20T11:26:40.569 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2020-11-20T11:26:40.759 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2020-11-20T11:26:40.759 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2020-11-20T11:26:40.908 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:41.067 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:41.352 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:41.559 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:41.801 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:41.900 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:42.321 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2020-11-20T11:26:42.321 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2020-11-20T11:26:42.403 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:26:42.526 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:42.701 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:42.947 INFO:teuthology.orchestra.run.smithi105.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T11:26:43.112 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T11:26:43.285 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T11:26:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T11:26:43.601 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:43.962 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:44.226 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:44.295 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:44.597 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:44.776 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:44.880 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:48.456 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2020-11-20T11:26:48.456 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T11:26:48.456 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:48.457 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:48.457 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2020-11-20T11:26:48.457 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T11:26:48.457 INFO:teuthology.orchestra.run.smithi100.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:48.458 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T11:26:48.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T11:26:48.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T11:26:48.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T11:26:48.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:48.459 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:48.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T11:26:48.460 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:48.460 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:48.460 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:48.460 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:48.461 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:48.461 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:48.461 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T11:26:48.461 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T11:26:48.461 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T11:26:48.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T11:26:48.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:48.462 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:48.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:48.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T11:26:48.498 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T11:26:48.557 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T11:26:48.654 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T11:26:48.740 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:48.806 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T11:26:48.839 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:48.863 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T11:26:48.971 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T11:26:49.087 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T11:26:49.096 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T11:26:49.228 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:49.278 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T11:26:49.329 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T11:26:49.376 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:26:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T11:26:49.633 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:49.719 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:49.994 INFO:teuthology.orchestra.run.smithi100.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T11:26:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T11:26:50.201 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T11:26:50.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T11:26:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:50.406 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T11:26:50.498 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T11:26:50.559 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T11:26:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T11:26:50.730 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:50.745 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T11:26:50.828 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:50.928 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T11:26:50.967 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:26:51.088 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:51.094 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:51.171 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T11:26:51.397 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:51.442 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:51.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:26:51.738 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:51.845 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:52.007 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:26:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T11:26:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T11:26:52.444 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T11:26:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T11:26:52.616 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T11:26:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T11:26:52.840 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T11:26:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T11:26:52.904 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:26:53.002 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:53.235 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T11:26:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:53.357 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T11:26:53.421 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:53.469 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T11:26:53.685 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T11:26:53.694 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:53.747 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T11:26:53.913 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T11:26:53.985 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:54.067 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:54.086 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T11:26:54.155 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:54.269 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:54.273 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T11:26:54.373 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T11:26:54.650 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T11:26:54.704 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:54.779 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T11:26:54.797 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T11:26:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:54.984 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T11:26:55.103 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T11:26:55.123 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T11:26:55.284 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T11:26:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T11:26:55.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:55.519 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T11:26:55.591 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:55.624 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T11:26:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T11:26:55.819 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:55.897 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T11:26:55.905 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T11:26:56.070 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T11:26:56.135 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T11:26:56.209 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T11:26:56.300 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T11:26:56.376 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T11:26:56.389 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T11:26:56.526 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T11:26:56.527 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:56.583 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T11:26:56.734 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T11:26:56.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T11:26:56.875 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T11:26:56.879 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T11:26:57.051 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T11:26:57.100 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T11:26:57.115 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T11:26:57.226 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T11:26:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:57.387 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T11:26:57.607 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T11:26:57.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T11:26:57.956 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T11:26:58.009 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T11:26:58.065 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T11:26:58.096 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T11:26:58.278 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T11:26:58.317 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T11:26:58.394 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T11:26:58.458 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T11:26:58.518 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T11:26:58.613 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T11:26:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T11:26:58.698 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T11:26:58.865 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T11:26:58.879 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:26:58.894 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T11:26:59.093 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T11:26:59.098 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T11:26:59.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T11:26:59.264 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T11:26:59.442 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T11:26:59.451 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T11:26:59.622 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T11:26:59.805 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T11:27:00.020 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T11:27:00.227 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T11:27:00.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T11:27:00.394 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T11:27:00.818 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:27:00.852 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T11:27:01.131 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T11:27:01.154 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T11:27:01.326 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:27:01.424 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T11:27:01.444 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T11:27:01.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T11:27:01.677 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T11:27:01.863 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T11:27:01.884 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T11:27:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T11:27:02.110 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T11:27:02.283 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T11:27:02.286 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T11:27:02.438 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T11:27:02.499 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T11:27:02.602 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T11:27:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T11:27:02.861 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T11:27:02.875 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:27:03.061 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T11:27:03.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T11:27:03.202 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T11:27:03.342 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T11:27:03.403 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T11:27:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T11:27:03.587 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T11:27:03.632 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T11:27:03.632 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T11:27:03.633 INFO:teuthology.orchestra.run.smithi105.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:27:03.633 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:03.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T11:27:03.776 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T11:27:03.952 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T11:27:03.966 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T11:27:03.975 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T11:27:04.157 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T11:27:04.191 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T11:27:04.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T11:27:04.379 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T11:27:04.410 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T11:27:04.459 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T11:27:04.606 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T11:27:04.647 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T11:27:04.759 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T11:27:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T11:27:04.870 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T11:27:04.951 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T11:27:05.017 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T11:27:05.065 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T11:27:05.167 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T11:27:05.272 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T11:27:05.372 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T11:27:05.381 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T11:27:05.418 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T11:27:05.550 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T11:27:05.615 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T11:27:05.656 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T11:27:05.782 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T11:27:05.822 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T11:27:05.889 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T11:27:06.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T11:27:06.135 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T11:27:06.268 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T11:27:06.275 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T11:27:06.465 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T11:27:06.467 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T11:27:06.718 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T11:27:06.764 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T11:27:06.938 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T11:27:06.964 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T11:27:07.143 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T11:27:07.173 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T11:27:07.363 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T11:27:07.417 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T11:27:07.524 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T11:27:07.658 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T11:27:07.719 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T11:27:07.896 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T11:27:07.922 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T11:27:08.116 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T11:27:08.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T11:27:08.345 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T11:27:08.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T11:27:08.538 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T11:27:08.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T11:27:08.709 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T11:27:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T11:27:08.877 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T11:27:09.052 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T11:27:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T11:27:09.245 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T11:27:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T11:27:09.417 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T11:27:09.630 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T11:27:09.849 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T11:27:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T11:27:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T11:27:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T11:27:10.571 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T11:27:10.714 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T11:27:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T11:27:10.842 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:10.922 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:10.930 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T11:27:11.039 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T11:27:11.233 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T11:27:11.248 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T11:27:11.424 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T11:27:11.454 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T11:27:11.592 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T11:27:11.765 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T11:27:12.065 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:27:12.306 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T11:27:12.447 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T11:27:12.572 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T11:27:12.681 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T11:27:12.920 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T11:27:12.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T11:27:12.921 INFO:teuthology.orchestra.run.smithi100.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:27:12.921 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:27:12.955 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T11:27:13.180 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T11:27:13.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T11:27:13.473 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T11:27:13.536 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T11:27:13.662 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T11:27:13.763 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T11:27:13.808 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T11:27:13.964 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T11:27:14.186 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T11:27:14.280 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:27:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T11:27:14.546 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T11:27:14.680 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T11:27:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T11:27:14.905 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T11:27:15.103 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T11:27:15.103 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T11:27:15.103 INFO:teuthology.orchestra.run.smithi067.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:27:15.103 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:27:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T11:27:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T11:27:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T11:27:15.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T11:27:16.060 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T11:27:16.481 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T11:27:16.782 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T11:27:17.126 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T11:27:17.475 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T11:27:17.642 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T11:27:19.208 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:20.117 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:20.829 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:21.134 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:21.226 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:21.392 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:22.531 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:22.791 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:23.562 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T11:27:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:23.973 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T11:27:24.149 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:27.904 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:27.905 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2020-11-20T11:27:27.905 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2020-11-20T11:27:27.905 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2020-11-20T11:27:27.906 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /run 2020-11-20T11:27:27.906 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2020-11-20T11:27:27.906 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2020-11-20T11:27:27.907 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2020-11-20T11:27:27.907 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2020-11-20T11:27:27.907 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2020-11-20T11:27:27.908 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:28.262 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:28.707 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:30.400 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:30.563 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:30.595 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:30.776 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T11:27:30.997 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T11:27:31.178 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:31.255 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:31.548 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T11:27:31.787 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T11:27:33.686 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:36.155 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:36.155 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T11:27:36.156 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T11:27:36.156 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:36.156 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:36.156 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:36.416 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:36.591 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:36.671 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:36.997 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T11:27:37.204 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:37.233 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:37.377 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:37.391 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:37.571 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T11:27:37.710 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:38.137 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2020-11-20T11:27:38.137 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2020-11-20T11:27:38.137 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2020-11-20T11:27:38.137 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /run 2020-11-20T11:27:38.138 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2020-11-20T11:27:38.138 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2020-11-20T11:27:38.138 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2020-11-20T11:27:38.138 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2020-11-20T11:27:38.138 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2020-11-20T11:27:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:27:38.539 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:38.987 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:40.955 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:40.985 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T11:27:41.432 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T11:27:41.754 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:41.889 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T11:27:41.889 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2020-11-20T11:27:41.890 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2020-11-20T11:27:41.890 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2020-11-20T11:27:41.890 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /run 2020-11-20T11:27:41.890 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2020-11-20T11:27:41.891 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2020-11-20T11:27:41.891 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2020-11-20T11:27:41.891 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2020-11-20T11:27:41.891 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2020-11-20T11:27:41.891 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:27:42.066 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:42.133 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:42.306 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:42.639 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T11:27:42.774 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T11:27:42.889 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T11:27:43.390 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:43.392 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T11:27:43.588 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:43.965 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:44.833 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:44.833 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:44.834 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T11:27:44.902 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:44.948 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T11:27:44.980 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:45.002 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T11:27:45.161 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:45.188 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:45.193 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T11:27:45.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T11:27:45.609 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T11:27:45.805 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T11:27:45.954 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T11:27:46.034 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:46.157 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T11:27:46.170 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T11:27:46.329 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:46.345 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T11:27:46.405 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T11:27:46.537 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T11:27:46.687 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T11:27:46.874 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T11:27:47.289 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T11:27:47.365 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:47.631 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:47.634 INFO:teuthology.orchestra.run.smithi105.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T11:27:47.711 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:47.841 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:47.841 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T11:27:48.020 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T11:27:48.061 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T11:27:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T11:27:48.276 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:27:48.340 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T11:27:48.382 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:27:48.593 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:48.660 INFO:teuthology.orchestra.run.smithi105.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T11:27:48.834 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T11:27:49.009 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:27:49.048 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T11:27:49.087 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:27:49.275 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:27:49.279 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:49.307 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:49.316 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:27:49.454 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:53.772 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T11:27:53.773 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:53.773 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T11:27:53.773 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:53.773 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T11:27:53.774 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T11:27:53.774 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:53.774 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T11:27:53.774 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:53.774 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:53.775 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T11:27:53.775 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:53.775 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T11:27:53.775 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T11:27:53.775 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T11:27:53.776 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T11:27:53.776 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T11:27:53.776 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:27:53.776 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:27:53.777 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:27:53.777 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:27:53.777 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:27:53.777 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:27:53.777 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:27:53.778 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:27:53.778 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:27:53.778 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:27:53.778 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:27:53.778 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:27:53.779 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T11:27:53.779 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T11:27:53.779 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T11:27:53.779 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T11:27:53.779 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T11:27:53.780 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T11:27:53.780 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T11:27:53.780 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T11:27:53.780 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T11:27:53.781 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T11:27:53.781 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:27:53.781 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:27:53.781 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T11:27:53.781 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T11:27:53.782 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T11:27:53.782 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T11:27:53.782 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T11:27:53.782 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T11:27:53.783 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T11:27:53.783 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T11:27:53.783 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T11:27:53.783 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T11:27:53.783 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T11:27:53.784 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T11:27:53.784 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T11:27:53.784 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T11:27:53.784 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T11:27:53.784 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T11:27:53.785 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T11:27:53.786 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T11:27:53.787 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T11:27:53.787 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T11:27:53.787 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T11:27:53.787 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T11:27:53.787 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T11:27:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T11:27:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T11:27:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T11:27:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T11:27:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T11:27:53.789 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T11:27:53.789 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T11:27:53.789 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T11:27:53.789 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T11:27:53.790 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T11:27:53.790 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T11:27:53.790 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T11:27:53.790 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T11:27:53.790 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T11:27:53.791 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T11:27:53.791 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T11:27:53.791 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T11:27:53.792 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T11:27:53.792 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T11:27:53.792 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T11:27:53.792 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T11:27:53.792 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T11:27:53.793 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T11:27:53.793 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T11:27:53.793 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T11:27:53.793 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T11:27:53.794 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T11:27:53.794 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T11:27:53.794 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T11:27:53.794 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T11:27:53.794 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T11:27:53.795 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T11:27:53.795 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T11:27:53.795 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T11:27:53.795 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T11:27:53.796 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T11:27:53.796 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T11:27:53.796 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T11:27:53.796 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T11:27:53.796 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T11:27:53.797 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T11:27:53.797 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T11:27:53.797 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T11:27:53.797 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T11:27:53.797 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T11:27:53.798 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T11:27:53.798 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T11:27:53.798 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T11:27:53.798 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:27:53.798 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T11:27:53.799 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T11:27:53.799 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T11:27:53.799 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T11:27:53.799 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T11:27:53.800 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T11:27:53.800 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T11:27:53.800 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T11:27:53.800 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T11:27:53.800 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T11:27:53.801 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T11:27:53.801 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T11:27:53.801 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T11:27:53.801 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T11:27:53.801 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T11:27:53.802 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T11:27:53.802 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T11:27:53.802 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T11:27:53.802 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T11:27:53.803 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T11:27:53.803 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T11:27:53.803 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T11:27:53.803 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T11:27:53.803 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T11:27:53.804 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T11:27:53.804 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T11:27:53.804 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T11:27:53.804 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T11:27:53.804 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T11:27:53.805 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T11:27:53.805 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T11:27:53.805 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T11:27:53.805 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T11:27:53.805 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T11:27:53.806 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T11:27:53.806 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T11:27:53.806 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T11:27:53.806 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T11:27:53.806 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T11:27:53.807 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T11:27:53.807 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T11:27:53.807 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T11:27:53.807 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T11:27:53.807 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T11:27:53.808 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T11:27:53.808 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T11:27:53.808 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T11:27:53.808 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T11:27:53.809 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T11:27:53.809 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T11:27:53.809 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T11:27:53.809 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T11:27:53.809 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T11:27:53.810 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T11:27:53.810 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T11:27:53.810 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T11:27:53.810 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T11:27:53.810 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T11:27:53.811 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T11:27:53.811 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:27:53.811 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T11:27:53.811 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:27:53.811 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T11:27:53.812 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T11:27:53.812 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:53.812 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2020-11-20T11:27:53.812 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.812 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.813 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:27:53.813 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:27:53.813 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:27:53.813 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:27:53.814 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:53.814 INFO:teuthology.orchestra.run.smithi105.stdout:Downgraded: 2020-11-20T11:27:53.814 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T11:27:53.814 INFO:teuthology.orchestra.run.smithi105.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:27:53.814 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:27:53.815 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:53.815 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2020-11-20T11:27:53.815 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.815 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.815 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.816 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.816 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.816 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.816 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.816 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.817 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.817 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.817 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.817 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.817 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.818 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.818 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.818 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.818 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.818 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.819 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.819 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.819 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.819 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.819 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:27:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:27:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:27:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T11:27:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:27:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T11:27:53.821 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:27:53.821 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T11:27:53.821 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:27:53.821 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:27:53.822 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.822 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.822 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.822 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.822 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.823 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.823 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.823 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.823 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:27:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:27:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:27:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:27:53.825 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:27:53.825 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:27:53.825 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T11:27:53.825 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T11:27:53.825 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T11:27:53.826 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:27:53.826 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:27:53.826 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:27:53.826 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:27:53.826 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:27:53.827 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:27:53.827 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:27:53.827 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:27:53.827 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:27:53.828 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:27:53.828 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:27:53.828 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:27:53.828 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:27:53.828 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T11:27:53.829 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:27:53.829 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:27:53.829 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T11:27:53.829 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:27:53.829 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:27:53.830 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:27:53.830 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T11:27:53.830 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T11:27:53.831 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T11:27:53.831 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T11:27:53.831 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T11:27:53.831 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T11:27:53.831 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:27:53.832 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:27:53.832 INFO:teuthology.orchestra.run.smithi105.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T11:27:53.832 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T11:27:53.832 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T11:27:53.832 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T11:27:53.833 INFO:teuthology.orchestra.run.smithi105.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T11:27:53.833 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:27:53.833 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:27:53.833 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T11:27:53.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T11:27:53.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:27:53.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T11:27:53.834 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T11:27:53.834 INFO:teuthology.orchestra.run.smithi105.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:27:53.835 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:27:53.835 INFO:teuthology.orchestra.run.smithi105.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:27:53.835 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:27:53.835 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:27:53.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:27:53.836 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:27:53.836 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:27:53.836 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:27:53.836 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:27:53.836 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:27:53.837 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:27:53.837 INFO:teuthology.orchestra.run.smithi105.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:27:53.837 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:27:53.837 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:27:53.837 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:27:53.838 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:27:53.838 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:27:53.838 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:27:53.838 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:27:53.838 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:27:53.839 INFO:teuthology.orchestra.run.smithi105.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:27:53.839 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:27:53.839 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:27:53.839 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:27:53.839 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:27:53.840 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:27:53.840 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:27:53.840 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:27:53.840 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:27:53.840 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:27:53.841 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:27:53.841 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:27:53.841 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:27:53.841 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:27:53.842 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:27:53.842 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2020-11-20T11:27:53.842 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T11:27:53.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T11:27:53.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:53.903 DEBUG:teuthology.parallel:result is None 2020-11-20T11:27:54.315 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:56.090 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T11:27:56.345 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:56.702 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:56.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:56.979 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T11:27:57.044 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:57.958 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T11:27:58.213 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T11:27:58.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T11:27:58.380 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T11:27:58.563 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T11:27:58.587 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T11:27:58.918 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T11:27:58.963 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T11:27:59.195 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:59.272 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T11:27:59.407 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T11:27:59.836 INFO:teuthology.orchestra.run.smithi100.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T11:28:00.097 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T11:28:00.222 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T11:28:00.305 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T11:28:00.490 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T11:28:00.511 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:28:00.625 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:28:00.664 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T11:28:00.864 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T11:28:01.039 INFO:teuthology.orchestra.run.smithi100.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T11:28:01.059 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T11:28:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T11:28:01.254 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T11:28:01.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:28:01.376 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:28:01.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:28:01.628 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:28:01.704 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T11:28:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T11:28:02.020 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T11:28:02.087 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T11:28:02.206 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T11:28:02.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T11:28:02.389 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T11:28:02.564 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T11:28:02.605 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T11:28:02.606 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:28:02.795 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:28:02.888 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:28:02.911 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T11:28:03.054 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:28:03.069 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:03.070 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:03.187 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T11:28:03.364 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:03.364 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:03.408 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T11:28:03.594 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:28:03.663 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:03.664 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:28:03.679 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T11:28:03.877 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:28:03.901 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T11:28:03.970 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:28:03.971 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:28:04.046 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T11:28:04.212 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T11:28:04.390 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T11:28:04.574 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T11:28:04.796 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T11:28:04.796 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:28:04.856 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:28:04.857 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T11:28:04.857 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T11:28:04.857 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T11:28:04.857 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T11:28:04.858 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T11:28:04.858 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T11:28:04.858 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T11:28:04.858 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T11:28:04.858 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T11:28:04.859 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T11:28:04.859 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:28:04.859 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:28:04.859 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T11:28:04.860 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T11:28:04.860 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T11:28:04.860 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T11:28:04.860 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T11:28:04.860 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T11:28:04.861 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T11:28:04.861 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T11:28:04.861 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T11:28:04.861 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T11:28:04.862 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T11:28:04.862 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T11:28:04.862 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T11:28:04.862 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T11:28:04.863 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T11:28:04.863 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T11:28:04.863 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T11:28:04.863 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T11:28:04.863 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T11:28:04.864 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T11:28:04.864 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T11:28:04.864 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T11:28:04.864 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T11:28:04.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T11:28:04.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T11:28:04.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T11:28:04.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T11:28:04.865 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T11:28:04.866 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T11:28:04.866 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T11:28:04.866 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T11:28:04.866 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T11:28:04.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T11:28:04.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T11:28:04.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T11:28:04.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T11:28:04.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T11:28:04.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T11:28:04.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T11:28:04.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T11:28:04.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T11:28:04.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T11:28:04.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T11:28:04.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T11:28:04.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T11:28:04.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T11:28:04.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T11:28:04.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T11:28:04.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T11:28:04.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T11:28:04.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T11:28:04.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T11:28:04.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T11:28:04.872 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T11:28:04.872 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T11:28:04.872 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T11:28:04.872 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T11:28:04.872 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T11:28:04.873 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T11:28:04.873 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T11:28:04.873 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T11:28:04.873 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T11:28:04.874 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T11:28:04.874 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T11:28:04.874 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T11:28:04.875 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T11:28:04.875 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T11:28:04.875 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T11:28:04.875 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T11:28:04.876 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T11:28:04.876 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T11:28:04.877 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:28:04.877 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T11:28:04.877 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T11:28:04.878 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T11:28:04.878 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T11:28:04.878 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T11:28:04.878 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T11:28:04.879 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T11:28:04.879 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T11:28:04.879 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T11:28:04.879 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T11:28:04.879 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T11:28:04.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T11:28:04.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T11:28:04.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T11:28:04.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T11:28:04.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T11:28:04.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T11:28:04.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T11:28:04.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T11:28:04.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T11:28:04.882 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T11:28:04.882 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T11:28:04.882 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T11:28:04.882 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T11:28:04.883 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T11:28:04.883 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T11:28:04.883 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T11:28:04.883 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T11:28:04.883 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T11:28:04.884 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T11:28:04.884 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T11:28:04.884 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T11:28:04.884 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T11:28:04.884 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T11:28:04.885 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T11:28:04.885 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T11:28:04.885 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T11:28:04.885 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T11:28:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T11:28:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T11:28:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T11:28:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T11:28:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T11:28:04.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T11:28:04.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T11:28:04.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T11:28:04.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T11:28:04.887 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T11:28:04.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T11:28:04.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T11:28:04.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T11:28:04.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T11:28:04.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T11:28:04.889 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T11:28:04.889 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T11:28:04.889 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T11:28:04.889 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T11:28:04.890 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T11:28:04.890 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T11:28:04.890 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:28:04.890 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T11:28:04.890 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:04.891 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T11:28:05.063 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T11:28:05.213 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:28:05.241 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:05.242 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:05.498 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T11:28:05.499 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:05.758 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:05.758 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:28:05.998 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T11:28:05.999 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:28:06.621 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T11:28:06.622 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:06.622 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2020-11-20T11:28:06.622 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.623 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.623 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:06.623 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:06.624 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:06.624 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:06.624 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:06.624 INFO:teuthology.orchestra.run.smithi100.stdout:Downgraded: 2020-11-20T11:28:06.625 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T11:28:06.625 INFO:teuthology.orchestra.run.smithi100.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:06.625 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:06.625 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:06.626 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2020-11-20T11:28:06.626 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.626 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.627 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.627 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.628 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.628 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.628 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.629 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.629 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.629 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.629 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.630 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.630 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.631 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.631 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.631 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.631 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.632 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.632 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.632 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:28:06.632 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:28:06.633 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:28:06.633 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T11:28:06.633 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:28:06.634 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T11:28:06.634 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:06.634 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T11:28:06.634 INFO:teuthology.orchestra.run.smithi100.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:28:06.635 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:28:06.635 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.635 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.636 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.636 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.636 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.636 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.638 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.638 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.638 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:06.638 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.639 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.639 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:06.639 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:28:06.640 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:28:06.640 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:28:06.640 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:28:06.640 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T11:28:06.641 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T11:28:06.641 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T11:28:06.641 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:28:06.641 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:28:06.642 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:28:06.642 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:28:06.642 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:28:06.643 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:28:06.643 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:28:06.643 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:28:06.643 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:28:06.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:28:06.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:28:06.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:28:06.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:28:06.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T11:28:06.645 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:28:06.645 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:28:06.645 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T11:28:06.646 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:28:06.646 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:28:06.646 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:28:06.646 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T11:28:06.646 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T11:28:06.647 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T11:28:06.647 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T11:28:06.647 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T11:28:06.647 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T11:28:06.648 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:28:06.648 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:28:06.648 INFO:teuthology.orchestra.run.smithi100.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T11:28:06.648 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T11:28:06.649 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T11:28:06.649 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T11:28:06.649 INFO:teuthology.orchestra.run.smithi100.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T11:28:06.649 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:28:06.650 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:28:06.650 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T11:28:06.650 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T11:28:06.651 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:28:06.651 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T11:28:06.651 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T11:28:06.651 INFO:teuthology.orchestra.run.smithi100.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:28:06.652 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:28:06.652 INFO:teuthology.orchestra.run.smithi100.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:28:06.652 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:28:06.652 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:28:06.653 INFO:teuthology.orchestra.run.smithi100.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:28:06.653 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:28:06.653 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:28:06.654 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:28:06.654 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:28:06.654 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:28:06.654 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:28:06.655 INFO:teuthology.orchestra.run.smithi100.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:28:06.655 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:28:06.655 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:28:06.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:28:06.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:28:06.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:28:06.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:28:06.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:28:06.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:28:06.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:28:06.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:28:06.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:28:06.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:28:06.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:28:06.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:28:06.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:28:06.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:28:06.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:28:06.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:28:06.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:28:06.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:28:06.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:28:06.661 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:28:06.661 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:06.662 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2020-11-20T11:28:06.795 DEBUG:teuthology.parallel:result is None 2020-11-20T11:28:06.904 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T11:28:06.905 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T11:28:06.905 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T11:28:06.905 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T11:28:06.905 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T11:28:06.906 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T11:28:06.906 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T11:28:06.906 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T11:28:06.906 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T11:28:06.907 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T11:28:06.907 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T11:28:06.907 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T11:28:06.907 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T11:28:06.908 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T11:28:06.908 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T11:28:06.908 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T11:28:06.908 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T11:28:06.908 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T11:28:06.909 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T11:28:06.909 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T11:28:06.909 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T11:28:06.909 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T11:28:06.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T11:28:06.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T11:28:06.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T11:28:06.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T11:28:06.911 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T11:28:06.911 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T11:28:06.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T11:28:06.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T11:28:06.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T11:28:06.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T11:28:06.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T11:28:06.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T11:28:06.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T11:28:06.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T11:28:06.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T11:28:06.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T11:28:06.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T11:28:06.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T11:28:06.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T11:28:06.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T11:28:06.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T11:28:06.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T11:28:06.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T11:28:06.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T11:28:06.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T11:28:06.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T11:28:06.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T11:28:06.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T11:28:06.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T11:28:06.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T11:28:06.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T11:28:06.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T11:28:06.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T11:28:06.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T11:28:06.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T11:28:06.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T11:28:06.930 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T11:28:06.930 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T11:28:06.930 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T11:28:06.930 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T11:28:06.931 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T11:28:06.931 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T11:28:06.931 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T11:28:06.931 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T11:28:06.932 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T11:28:06.932 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T11:28:06.932 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T11:28:06.932 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T11:28:06.933 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T11:28:06.933 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T11:28:06.933 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T11:28:06.934 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T11:28:06.934 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T11:28:06.934 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T11:28:06.934 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T11:28:06.935 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T11:28:06.935 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T11:28:06.936 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T11:28:06.936 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T11:28:06.936 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T11:28:06.937 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T11:28:06.937 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T11:28:06.937 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T11:28:06.938 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T11:28:06.938 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T11:28:06.938 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T11:28:06.939 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T11:28:06.939 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T11:28:06.939 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T11:28:06.939 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T11:28:06.940 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T11:28:06.940 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T11:28:06.940 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T11:28:06.940 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T11:28:06.941 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T11:28:06.941 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T11:28:06.941 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T11:28:06.941 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T11:28:06.941 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T11:28:06.942 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T11:28:06.942 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T11:28:06.942 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T11:28:06.942 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T11:28:06.943 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T11:28:06.943 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T11:28:06.943 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T11:28:06.943 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T11:28:06.943 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T11:28:06.944 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T11:28:06.944 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T11:28:06.944 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T11:28:06.944 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T11:28:06.944 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T11:28:06.945 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T11:28:06.945 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T11:28:06.945 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T11:28:06.945 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T11:28:06.945 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T11:28:06.946 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T11:28:06.946 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T11:28:06.946 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T11:28:06.946 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T11:28:06.947 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T11:28:06.947 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T11:28:06.947 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T11:28:06.947 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T11:28:06.948 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T11:28:06.948 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T11:28:06.948 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T11:28:06.948 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T11:28:06.948 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T11:28:06.949 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T11:28:06.949 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T11:28:06.949 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T11:28:06.949 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T11:28:06.950 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T11:28:06.950 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T11:28:06.950 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T11:28:06.950 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T11:28:06.950 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T11:28:06.951 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T11:28:06.951 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T11:28:06.951 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T11:28:06.951 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T11:28:06.951 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T11:28:06.952 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T11:28:08.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T11:28:08.725 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:08.726 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2020-11-20T11:28:08.726 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.726 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.727 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:08.728 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:08.728 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:08.728 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T11:28:08.729 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:08.729 INFO:teuthology.orchestra.run.smithi067.stdout:Downgraded: 2020-11-20T11:28:08.730 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T11:28:08.730 INFO:teuthology.orchestra.run.smithi067.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:08.731 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:08.732 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:08.732 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2020-11-20T11:28:08.733 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.735 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.736 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.736 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.736 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.737 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.737 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.737 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.739 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.740 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.740 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.740 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.741 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.741 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.741 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.742 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.742 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.743 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.743 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.743 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.744 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.744 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:28:08.745 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:28:08.746 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:28:08.746 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T11:28:08.746 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:28:08.747 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T11:28:08.748 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T11:28:08.748 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T11:28:08.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:28:08.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:28:08.749 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.750 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.750 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.750 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.750 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.751 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.751 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.751 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.752 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:28:08.752 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.753 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.753 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:28:08.753 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:28:08.754 INFO:teuthology.orchestra.run.smithi067.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:28:08.754 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:28:08.754 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:28:08.755 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T11:28:08.755 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T11:28:08.755 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T11:28:08.756 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:28:08.756 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:28:08.756 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:28:08.757 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:28:08.757 INFO:teuthology.orchestra.run.smithi067.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:28:08.757 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:28:08.758 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:28:08.758 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:28:08.758 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:28:08.759 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:28:08.759 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:28:08.759 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:28:08.760 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:28:08.760 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T11:28:08.760 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:28:08.761 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:28:08.761 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T11:28:08.761 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:28:08.762 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:28:08.762 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:28:08.762 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T11:28:08.763 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T11:28:08.763 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T11:28:08.763 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T11:28:08.764 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T11:28:08.764 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T11:28:08.764 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:28:08.765 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:28:08.765 INFO:teuthology.orchestra.run.smithi067.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T11:28:08.765 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T11:28:08.766 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T11:28:08.766 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T11:28:08.766 INFO:teuthology.orchestra.run.smithi067.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T11:28:08.767 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:28:08.767 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:28:08.768 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T11:28:08.768 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T11:28:08.769 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:28:08.769 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T11:28:08.770 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T11:28:08.770 INFO:teuthology.orchestra.run.smithi067.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:28:08.770 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:28:08.771 INFO:teuthology.orchestra.run.smithi067.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:28:08.771 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:28:08.771 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:28:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:28:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:28:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:28:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:28:08.774 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:28:08.774 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:28:08.774 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:28:08.775 INFO:teuthology.orchestra.run.smithi067.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:28:08.775 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:28:08.775 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:28:08.776 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:28:08.776 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:28:08.776 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:28:08.777 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:28:08.777 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:28:08.778 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:28:08.778 INFO:teuthology.orchestra.run.smithi067.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:28:08.778 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:28:08.779 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:28:08.779 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:28:08.779 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:28:08.780 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:28:08.780 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:28:08.780 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:28:08.781 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:28:08.781 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:28:08.782 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:28:08.782 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:28:08.782 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:28:08.783 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:28:08.783 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:08.784 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2020-11-20T11:28:08.883 DEBUG:teuthology.parallel:result is None 2020-11-20T11:28:08.884 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-11-20T11:28:08.943 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-11-20T11:28:08.946 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:28:08.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:28:09.137 INFO:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:28:09.161 INFO:teuthology.orchestra.run.smithi105.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.162 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.163 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:28:09.163 INFO:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2020-11-20T11:28:09.223 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS 2020-11-20T11:28:09.224 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:28:09.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:28:09.391 INFO:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:28:09.412 INFO:teuthology.orchestra.run.smithi100.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.413 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.413 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:28:09.414 INFO:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2020-11-20T11:28:09.468 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS 2020-11-20T11:28:09.469 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T11:28:09.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:28:09.629 INFO:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:28:09.649 INFO:teuthology.orchestra.run.smithi067.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.650 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:28:09.650 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:28:09.651 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T11:28:09.651 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:09.652 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.668 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.683 INFO:teuthology.orchestra.run.smithi105.stderr:24+1 records in 2020-11-20T11:28:09.683 INFO:teuthology.orchestra.run.smithi105.stderr:24+1 records out 2020-11-20T11:28:09.684 INFO:teuthology.orchestra.run.smithi105.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.9045e-05 s, 160 MB/s 2020-11-20T11:28:09.685 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:09.685 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.701 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.717 INFO:teuthology.orchestra.run.smithi100.stderr:24+1 records in 2020-11-20T11:28:09.717 INFO:teuthology.orchestra.run.smithi100.stderr:24+1 records out 2020-11-20T11:28:09.717 INFO:teuthology.orchestra.run.smithi100.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.8108e-05 s, 162 MB/s 2020-11-20T11:28:09.718 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:09.719 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:28:09.748 INFO:teuthology.orchestra.run.smithi067.stderr:24+1 records in 2020-11-20T11:28:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:24+1 records out 2020-11-20T11:28:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.9855e-05 s, 159 MB/s 2020-11-20T11:28:09.750 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T11:28:09.750 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:09.751 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.766 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.780 INFO:teuthology.orchestra.run.smithi105.stderr:5+1 records in 2020-11-20T11:28:09.780 INFO:teuthology.orchestra.run.smithi105.stderr:5+1 records out 2020-11-20T11:28:09.781 INFO:teuthology.orchestra.run.smithi105.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.9439e-05 s, 61.9 MB/s 2020-11-20T11:28:09.782 INFO:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:28:09.851 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:09.852 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.882 INFO:teuthology.orchestra.run.smithi100.stderr:5+1 records in 2020-11-20T11:28:09.882 INFO:teuthology.orchestra.run.smithi100.stderr:5+1 records out 2020-11-20T11:28:09.882 INFO:teuthology.orchestra.run.smithi100.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 6.4464e-05 s, 47.4 MB/s 2020-11-20T11:28:09.883 INFO:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:28:09.954 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:09.955 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.968 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:28:09.985 INFO:teuthology.orchestra.run.smithi067.stderr:5+1 records in 2020-11-20T11:28:09.985 INFO:teuthology.orchestra.run.smithi067.stderr:5+1 records out 2020-11-20T11:28:09.986 INFO:teuthology.orchestra.run.smithi067.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.1062e-05 s, 74.5 MB/s 2020-11-20T11:28:09.987 INFO:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:28:10.058 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T11:28:10.059 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:10.059 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.075 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.088 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:10.088 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:10.089 INFO:teuthology.orchestra.run.smithi105.stderr:299 bytes copied, 2.874e-05 s, 10.4 MB/s 2020-11-20T11:28:10.090 INFO:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:28:10.159 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:10.159 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.191 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:10.192 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:10.192 INFO:teuthology.orchestra.run.smithi100.stderr:299 bytes copied, 3.5947e-05 s, 8.3 MB/s 2020-11-20T11:28:10.193 INFO:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:28:10.264 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:10.265 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:28:10.295 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:10.295 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:10.296 INFO:teuthology.orchestra.run.smithi067.stderr:299 bytes copied, 3.1885e-05 s, 9.4 MB/s 2020-11-20T11:28:10.297 INFO:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:28:10.369 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T11:28:10.423 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T11:28:10.424 INFO:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2020-11-20T11:28:10.426 INFO:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2020-11-20T11:28:10.429 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2020-11-20T11:28:10.459 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T11:28:10.459 INFO:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:28:10.498 INFO:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:28:10.500 INFO:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:28:10.530 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T11:28:10.531 INFO:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:28:10.568 INFO:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:28:10.570 INFO:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:28:10.630 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T11:28:10.631 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T11:28:10.631 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T11:28:10.632 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:10.633 INFO:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.654 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.655 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:10.655 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:10.655 INFO:teuthology.orchestra.run.smithi105.stderr:408 bytes copied, 2.8531e-05 s, 14.3 MB/s 2020-11-20T11:28:10.656 INFO:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:10.769 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:10.796 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:10.796 INFO:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.812 INFO:teuthology.orchestra.run.smithi100.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.813 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:10.813 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:10.813 INFO:teuthology.orchestra.run.smithi100.stderr:408 bytes copied, 3.1631e-05 s, 12.9 MB/s 2020-11-20T11:28:10.814 INFO:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:10.931 INFO:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:10.960 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:10.960 INFO:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.974 INFO:teuthology.orchestra.run.smithi067.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:28:10.975 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:10.976 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:10.976 INFO:teuthology.orchestra.run.smithi067.stderr:408 bytes copied, 3.9579e-05 s, 10.3 MB/s 2020-11-20T11:28:10.976 INFO:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:11.100 INFO:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:11.138 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T11:28:11.139 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T11:28:11.139 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/ffsb}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640245', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'SLOW_OPS', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.3608', 'targets': {'smithi105.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkPAjMQhO9TV4SJKimAvJ/BKn7jGvoGoRyL7y3a21BrljFkuyzFdE9gLS0R3D5FdBRS/dRCbGUkDIgWszOoyXRouDS3q2yVzBBK+45Zo5PejBfqn1KR4JGljVkKELxYtLYD7VJQMjzuPcSo0kENPmxhpRmTwEor2+vdNGEJyvWRNyyDu61xyfZGL5saJjcBg/ajCUeYaWg0R1gRHlLGNl+2YVhoGEF0HJ/nqkoa3mNBXXjEO10pF6gzintzonQsw4iBmhOYK2Fl+GlpNVXFJHGZY4N15ouHWJTTUvD7q7EKz/OeH2R60b7ZZq6FQVWT2oZJuNoyjP2/ydSLncDIFiwldsGZiKwXh1/0lsI9q4Oc8dH/79azLxB4KO81nSvKRtlH1kPBgFLwrHOhqB6ZREPjrzZBmREppcftBUDWCcUDxMpcktSZOdXY4NNANx0MHeV57GW7Ew9pI860XE+zO8QOSGawaA+M5GOGpSjhpksPLEazlmP2/SZGt6X2q+NDgk=', 'smithi100.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr7+mirjO4XZaOjvgvpGbajZxokCD+gUPA/vZi6BEQwgXkmW+yOLepRsXxw/0MO5C1lfQAD16/0TPg6l8gcbueuWUyxHOuPCCdayOnpsE9Hg4qWknAC1Oz9rgW9A7byLUk3G00b1CUx9gV/8FzBa8ueDyiLssO+oioGFLdRUlGxyNuxzAvM1s7BsYBZ7iq19k8U5jxD+TL6Hj+WjLphMZdGRYh1c7PdDXo8OxtNudeDk7OFQqkUF+hVZp7IzgioGXqUq1WB2ZZz2avrffRwzfvhulNM6U04bpgbMdZchdMZSZe1Kq03JaMtn5YasrB6QdQB8V0dthzYBzCvmmOGbnctK8r1jG2plZ2tz8qGtKDelG+ED7m6GqGprQUxM5cJbU4LbB3u04nrAk+wOWp5bueao4xOgnVEDPye5A+F/s7XDMbXUiRCPP54SdXR7L+6zt1kLHKGXY12YxlZMKePJIfYm+WDpUwAzBeslTKjWGrGw/mSTe/GPhDav7QSFjjIxs=', 'smithi067.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiiVYDQdzWTCL+kV4EuCRNXf+DuWSUrabcyBHQlvPwarDKIJ2NqLRd6asZxy1s8mYO8qow3GXOay8k3F2NKJAGuDtZ7vcGGRubMDqyZf7holSPC7U3FPDcU8CplOLEy38X3Q13ifQCEh5HCyMBuGxkpDxcD4j60uqMQeCPk0YEdvHv4eeNHQn/cVKnv71pervOdIhECSHyjZfmMU16sAS/rq8fXBGI3AF+ntolb6PZZ/iE5G5uJh1ss9fXseu7UzR+vl58nypsFuzpC3CYTJIsWuuNaCkTqsnu68pglzI0Q2hG7hN+fw5tazf50zRsFXHfz8rlqlVfRoJHsdghfdGOn+V4umf6b5QQqfRbm9H9Q3y3OC+OVkQNlKB9nbMKLPacnm0h3WIuGoqLt3oqJb02PQyKma1ww6QHDPQkfo0NfkXGaCsLASLCBSM86jnzLiXIZHL1fNCSy3iqR35Wb0mpE053i8j7IYITdQ8YWJYgMB7UBvTWak9AKUQoUfhQE9U='}} 2020-11-20T11:28:11.140 INFO:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:28:11.175 INFO:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:28:11.178 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:28:11.193 INFO:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:28:11.229 INFO:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:28:11.233 INFO:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:28:11.261 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:11.262 INFO:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.314 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.315 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:28:11.315 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:28:11.316 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:28:11.316 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:28:11.316 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:11.316 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:11.316 INFO:teuthology.orchestra.run.smithi105.stderr:72 bytes copied, 3.0751e-05 s, 2.3 MB/s 2020-11-20T11:28:11.317 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:28:11.317 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:28:11.368 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:28:11.369 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.369 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 58225 Links: 1 2020-11-20T11:28:11.369 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.370 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.370 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-11-20 11:27:51.716751047 +0000 2020-11-20T11:28:11.370 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-11-20 11:25:22.039321940 +0000 2020-11-20T11:28:11.370 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-11-20 11:25:22.039321940 +0000 2020-11-20T11:28:11.371 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-11-20T11:28:11.382 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-11-20T11:28:11.382 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-11-20T11:28:11.383 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.00021579 s, 2.4 MB/s 2020-11-20T11:28:11.385 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:28:11.438 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:28:11.439 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.439 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 59284 Links: 1 2020-11-20T11:28:11.439 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.439 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.440 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-11-20 11:27:51.716751047 +0000 2020-11-20T11:28:11.440 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-11-20 11:25:22.368316670 +0000 2020-11-20T11:28:11.440 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-11-20 11:25:22.368316670 +0000 2020-11-20T11:28:11.440 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-11-20T11:28:11.452 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-11-20T11:28:11.452 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-11-20T11:28:11.453 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.00021354 s, 2.4 MB/s 2020-11-20T11:28:11.454 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:28:11.508 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:28:11.508 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.508 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 59342 Links: 1 2020-11-20T11:28:11.508 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.509 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.509 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-11-20 11:27:51.716751047 +0000 2020-11-20T11:28:11.509 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-11-20 11:25:22.695311432 +0000 2020-11-20T11:28:11.509 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-11-20 11:25:22.695311432 +0000 2020-11-20T11:28:11.510 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-11-20T11:28:11.520 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-11-20T11:28:11.520 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-11-20T11:28:11.521 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.00022331 s, 2.3 MB/s 2020-11-20T11:28:11.523 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:28:11.577 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:28:11.577 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.577 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 60092 Links: 1 2020-11-20T11:28:11.578 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.578 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.578 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-11-20 11:27:51.716751047 +0000 2020-11-20T11:28:11.578 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-11-20 11:25:23.012306354 +0000 2020-11-20T11:28:11.578 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-11-20 11:25:23.012306354 +0000 2020-11-20T11:28:11.579 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-11-20T11:28:11.590 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-11-20T11:28:11.590 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-11-20T11:28:11.590 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000177658 s, 2.9 MB/s 2020-11-20T11:28:11.592 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:11.592 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:11.593 INFO:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.609 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:28:11.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:28:11.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:28:11.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:28:11.610 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:11.611 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:11.611 INFO:teuthology.orchestra.run.smithi100.stderr:72 bytes copied, 3.9245e-05 s, 1.8 MB/s 2020-11-20T11:28:11.611 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:28:11.612 INFO:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:28:11.665 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:28:11.665 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.666 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 59745 Links: 1 2020-11-20T11:28:11.666 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.666 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.667 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2020-11-20 11:28:04.488192963 +0000 2020-11-20T11:28:11.667 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2020-11-20 11:25:21.516279335 +0000 2020-11-20T11:28:11.667 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2020-11-20 11:25:21.516279335 +0000 2020-11-20T11:28:11.667 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2020-11-20T11:28:11.680 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2020-11-20T11:28:11.680 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2020-11-20T11:28:11.680 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000315214 s, 1.6 MB/s 2020-11-20T11:28:11.683 INFO:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:28:11.739 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:28:11.739 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.740 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 62725 Links: 1 2020-11-20T11:28:11.740 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.740 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.740 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2020-11-20 11:28:04.488192963 +0000 2020-11-20T11:28:11.740 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2020-11-20 11:25:21.830271675 +0000 2020-11-20T11:28:11.741 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2020-11-20 11:25:21.830271675 +0000 2020-11-20T11:28:11.741 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2020-11-20T11:28:11.754 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2020-11-20T11:28:11.754 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2020-11-20T11:28:11.754 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00022024 s, 2.3 MB/s 2020-11-20T11:28:11.758 INFO:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:28:11.813 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:28:11.814 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 59866 Links: 1 2020-11-20T11:28:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2020-11-20 11:28:04.489192939 +0000 2020-11-20T11:28:11.815 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2020-11-20 11:25:22.153263796 +0000 2020-11-20T11:28:11.815 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2020-11-20 11:25:22.153263796 +0000 2020-11-20T11:28:11.815 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2020-11-20T11:28:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2020-11-20T11:28:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2020-11-20T11:28:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000234315 s, 2.2 MB/s 2020-11-20T11:28:11.830 INFO:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:28:11.884 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:28:11.884 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.884 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 59931 Links: 1 2020-11-20T11:28:11.884 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2020-11-20 11:28:04.489192939 +0000 2020-11-20T11:28:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2020-11-20 11:25:22.513255013 +0000 2020-11-20T11:28:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2020-11-20 11:25:22.513255013 +0000 2020-11-20T11:28:11.885 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2020-11-20T11:28:11.897 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2020-11-20T11:28:11.897 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2020-11-20T11:28:11.897 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000184653 s, 2.8 MB/s 2020-11-20T11:28:11.899 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:11.900 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:11.900 INFO:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.916 INFO:teuthology.orchestra.run.smithi067.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:28:11.917 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:28:11.917 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:28:11.917 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:28:11.917 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:28:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:72 bytes copied, 3.9046e-05 s, 1.8 MB/s 2020-11-20T11:28:11.918 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:28:11.919 INFO:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:28:11.974 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:28:11.974 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:11.974 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 63648 Links: 1 2020-11-20T11:28:11.974 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:11.975 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:11.975 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2020-11-20 11:28:06.540592883 +0000 2020-11-20T11:28:11.975 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2020-11-20 11:25:21.429567216 +0000 2020-11-20T11:28:11.975 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2020-11-20 11:25:21.429567216 +0000 2020-11-20T11:28:11.975 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2020-11-20T11:28:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2020-11-20T11:28:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2020-11-20T11:28:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00024366 s, 2.1 MB/s 2020-11-20T11:28:11.996 INFO:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:28:12.052 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:28:12.052 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:12.053 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 58310 Links: 1 2020-11-20T11:28:12.053 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:12.053 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:12.053 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2020-11-20 11:28:06.540592883 +0000 2020-11-20T11:28:12.054 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2020-11-20 11:25:21.764559927 +0000 2020-11-20T11:28:12.054 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2020-11-20 11:25:21.764559927 +0000 2020-11-20T11:28:12.054 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2020-11-20T11:28:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2020-11-20T11:28:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2020-11-20T11:28:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000239635 s, 2.1 MB/s 2020-11-20T11:28:12.072 INFO:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:28:12.128 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:28:12.128 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:12.128 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 64667 Links: 1 2020-11-20T11:28:12.129 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:12.129 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:12.129 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2020-11-20 11:28:06.541592861 +0000 2020-11-20T11:28:12.129 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2020-11-20 11:25:22.118552224 +0000 2020-11-20T11:28:12.129 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2020-11-20 11:25:22.118552224 +0000 2020-11-20T11:28:12.130 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2020-11-20T11:28:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2020-11-20T11:28:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2020-11-20T11:28:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225415 s, 2.3 MB/s 2020-11-20T11:28:12.148 INFO:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:28:12.203 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:28:12.204 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:28:12.204 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 60309 Links: 1 2020-11-20T11:28:12.204 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:28:12.204 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:28:12.205 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2020-11-20 11:28:06.541592861 +0000 2020-11-20T11:28:12.205 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2020-11-20 11:25:22.463544717 +0000 2020-11-20T11:28:12.205 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2020-11-20 11:25:22.463544717 +0000 2020-11-20T11:28:12.205 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2020-11-20T11:28:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2020-11-20T11:28:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2020-11-20T11:28:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000210616 s, 2.4 MB/s 2020-11-20T11:28:12.223 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:12.224 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:28:12.224 INFO:tasks.ceph:Generating config... 2020-11-20T11:28:12.225 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T11:28:12.225 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T11:28:12.226 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T11:28:12.226 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T11:28:12.226 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T11:28:12.227 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T11:28:12.227 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T11:28:12.227 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T11:28:12.227 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T11:28:12.228 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T11:28:12.228 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T11:28:12.228 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T11:28:12.229 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T11:28:12.229 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T11:28:12.229 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T11:28:12.229 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T11:28:12.230 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T11:28:12.230 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T11:28:12.230 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T11:28:12.230 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T11:28:12.231 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T11:28:12.231 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T11:28:12.231 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T11:28:12.231 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T11:28:12.232 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T11:28:12.232 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T11:28:12.232 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T11:28:12.233 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T11:28:12.233 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T11:28:12.233 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T11:28:12.233 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T11:28:12.234 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T11:28:12.234 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T11:28:12.234 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T11:28:12.234 INFO:tasks.ceph:[osd] filestore flush min = 0 2020-11-20T11:28:12.235 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T11:28:12.235 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T11:28:12.235 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T11:28:12.236 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T11:28:12.236 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T11:28:12.236 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T11:28:12.237 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T11:28:12.237 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-11-20T11:28:12.237 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T11:28:12.238 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T11:28:12.286 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T11:28:12.288 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T11:28:12.330 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:12.399 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.105'), ('mon.b', '172.21.15.100'), ('mon.c', '172.21.15.67')] 2020-11-20T11:28:12.400 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.105,172.21.15.100,172.21.15.67'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T11:28:12.401 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:12.401 INFO:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:28:12.452 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:28:12.453 INFO:teuthology.orchestra.run.smithi105.stderr:6+1 records in 2020-11-20T11:28:12.453 INFO:teuthology.orchestra.run.smithi105.stderr:6+1 records out 2020-11-20T11:28:12.453 INFO:teuthology.orchestra.run.smithi105.stderr:3494 bytes (3.5 kB, 3.4 KiB) copied, 3.8067e-05 s, 91.8 MB/s 2020-11-20T11:28:12.454 INFO:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.105 --add b 172.21.15.100 --add c 172.21.15.67 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:12.532 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:12.532 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: generated fsid 6db90bc8-73b8-4163-bb1f-2d88eda44265 2020-11-20T11:28:12.532 INFO:teuthology.orchestra.run.smithi105.stdout:epoch 0 2020-11-20T11:28:12.533 INFO:teuthology.orchestra.run.smithi105.stdout:fsid 6db90bc8-73b8-4163-bb1f-2d88eda44265 2020-11-20T11:28:12.533 INFO:teuthology.orchestra.run.smithi105.stdout:last_changed 2020-11-20T11:28:12.530163+0000 2020-11-20T11:28:12.533 INFO:teuthology.orchestra.run.smithi105.stdout:created 2020-11-20T11:28:12.530163+0000 2020-11-20T11:28:12.533 INFO:teuthology.orchestra.run.smithi105.stdout:min_mon_release 0 (unknown) 2020-11-20T11:28:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:election_strategy: 1 2020-11-20T11:28:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:0: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.a 2020-11-20T11:28:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2020-11-20T11:28:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.c 2020-11-20T11:28:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T11:28:12.536 INFO:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:28:12.590 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6db90bc8-73b8-4163-bb1f-2d88eda44265... 2020-11-20T11:28:12.592 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:28:12.595 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:28:12.597 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:28:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2020-11-20T11:28:12.928 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2020-11-20T11:28:12.929 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:28:12.929 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2020-11-20T11:28:12.930 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.931 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2020-11-20T11:28:12.931 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.932 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2020-11-20T11:28:12.932 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.932 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2020-11-20T11:28:12.933 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2020-11-20T11:28:12.933 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.933 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2020-11-20T11:28:12.934 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2020-11-20T11:28:12.935 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.935 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:28:12.936 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2020-11-20T11:28:12.936 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.936 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:28:12.937 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:28:12.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.937 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2020-11-20T11:28:12.938 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.938 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2020-11-20T11:28:12.938 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2020-11-20T11:28:12.939 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:28:12.939 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:28:12.939 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2020-11-20T11:28:12.940 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:28:12.940 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2020-11-20T11:28:12.940 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:28:12.940 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:28:12.941 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2020-11-20T11:28:12.941 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.942 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:28:12.942 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.942 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2020-11-20T11:28:12.942 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.943 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2020-11-20T11:28:12.944 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.944 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2020-11-20T11:28:12.944 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2020-11-20T11:28:12.945 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2020-11-20T11:28:12.945 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.105,172.21.15.100,172.21.15.67" 2020-11-20T11:28:12.945 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 6db90bc8-73b8-4163-bb1f-2d88eda44265 2020-11-20T11:28:12.946 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.946 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2020-11-20T11:28:12.946 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2020-11-20T11:28:12.947 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.947 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2020-11-20T11:28:12.948 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2020-11-20T11:28:12.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.949 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2020-11-20T11:28:12.951 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2020-11-20T11:28:12.952 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.952 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2020-11-20T11:28:12.952 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2020-11-20T11:28:12.953 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2020-11-20T11:28:12.953 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.953 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2020-11-20T11:28:12.954 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2020-11-20T11:28:12.954 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.955 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:28:12.955 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.956 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2020-11-20T11:28:12.956 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.956 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2020-11-20T11:28:12.957 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.957 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:28:12.958 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2020-11-20T11:28:12.958 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.958 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2020-11-20T11:28:12.959 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2020-11-20T11:28:12.959 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2020-11-20T11:28:12.959 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2020-11-20T11:28:12.960 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2020-11-20T11:28:12.960 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2020-11-20T11:28:12.960 INFO:teuthology.orchestra.run.smithi100.stdout: debug filestore = 20 2020-11-20T11:28:12.960 INFO:teuthology.orchestra.run.smithi100.stdout: debug journal = 20 2020-11-20T11:28:12.961 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 20 2020-11-20T11:28:12.961 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 25 2020-11-20T11:28:12.961 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2020-11-20T11:28:12.962 INFO:teuthology.orchestra.run.smithi100.stdout: filestore flush min = 0 2020-11-20T11:28:12.962 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:28:12.963 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2020-11-20T11:28:12.963 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:28:12.963 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:28:12.963 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2020-11-20T11:28:12.964 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2020-11-20T11:28:12.964 INFO:teuthology.orchestra.run.smithi100.stdout: osd shutdown pgref assert = True 2020-11-20T11:28:12.965 INFO:teuthology.orchestra.run.smithi100.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:28:12.965 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.965 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2020-11-20T11:28:12.966 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2020-11-20T11:28:12.966 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2020-11-20T11:28:12.966 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2020-11-20T11:28:12.967 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2020-11-20T11:28:12.967 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:12.967 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:12.968 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2020-11-20T11:28:12.968 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.968 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2020-11-20T11:28:12.969 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2020-11-20T11:28:12.969 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2020-11-20T11:28:12.970 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2020-11-20T11:28:12.970 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2020-11-20T11:28:12.970 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2020-11-20T11:28:12.971 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2020-11-20T11:28:12.971 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:12.972 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2020-11-20T11:28:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2020-11-20T11:28:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2020-11-20T11:28:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-11-20T11:28:12.974 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2020-11-20T11:28:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2020-11-20T11:28:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2020-11-20T11:28:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2020-11-20T11:28:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:28:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:28:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2020-11-20T11:28:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2020-11-20T11:28:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2020-11-20T11:28:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 15m 2020-11-20T11:28:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 15m 2020-11-20T11:28:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2020-11-20T11:28:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2020-11-20T11:28:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2020-11-20T11:28:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2020-11-20T11:28:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2020-11-20T11:28:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2020-11-20T11:28:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2020-11-20T11:28:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2020-11-20T11:28:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2020-11-20T11:28:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal frag = True 2020-11-20T11:28:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal fragment size max = 10000 2020-11-20T11:28:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 5 2020-11-20T11:28:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split bits = 3 2020-11-20T11:28:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split size = 100 2020-11-20T11:28:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2020-11-20T11:28:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2020-11-20T11:28:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2020-11-20T11:28:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2020-11-20T11:28:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2020-11-20T11:28:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 15m 2020-11-20T11:28:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 15m 2020-11-20T11:28:12.985 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2020-11-20T11:28:12.985 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2020-11-20T11:28:12.985 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:28:12.986 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2020-11-20T11:28:12.986 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.986 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2020-11-20T11:28:12.986 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.987 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2020-11-20T11:28:12.987 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.987 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2020-11-20T11:28:12.987 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2020-11-20T11:28:12.987 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.988 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2020-11-20T11:28:12.988 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2020-11-20T11:28:12.988 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.988 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:28:12.988 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2020-11-20T11:28:12.989 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.989 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:28:12.989 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:28:12.989 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.990 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2020-11-20T11:28:12.990 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.991 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2020-11-20T11:28:12.991 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2020-11-20T11:28:12.991 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:28:12.991 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:28:12.992 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2020-11-20T11:28:12.992 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:28:12.992 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2020-11-20T11:28:12.992 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:28:12.992 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:28:12.993 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2020-11-20T11:28:12.993 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.993 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:28:12.993 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.994 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2020-11-20T11:28:12.994 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.994 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2020-11-20T11:28:12.994 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.994 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2020-11-20T11:28:12.995 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2020-11-20T11:28:12.995 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2020-11-20T11:28:12.995 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.105,172.21.15.100,172.21.15.67" 2020-11-20T11:28:12.995 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 6db90bc8-73b8-4163-bb1f-2d88eda44265 2020-11-20T11:28:12.995 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.996 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2020-11-20T11:28:12.996 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2020-11-20T11:28:12.996 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.996 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2020-11-20T11:28:12.996 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2020-11-20T11:28:12.997 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.997 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2020-11-20T11:28:12.997 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2020-11-20T11:28:12.997 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.997 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2020-11-20T11:28:12.998 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2020-11-20T11:28:12.998 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2020-11-20T11:28:12.998 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.998 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2020-11-20T11:28:12.998 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2020-11-20T11:28:12.999 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.999 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:28:12.999 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:12.999 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2020-11-20T11:28:12.999 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.000 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2020-11-20T11:28:13.000 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.000 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:28:13.000 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2020-11-20T11:28:13.000 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2020-11-20T11:28:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2020-11-20T11:28:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2020-11-20T11:28:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2020-11-20T11:28:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 20 2020-11-20T11:28:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 20 2020-11-20T11:28:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: debug filestore = 20 2020-11-20T11:28:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: debug journal = 20 2020-11-20T11:28:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 20 2020-11-20T11:28:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 25 2020-11-20T11:28:13.003 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 10 2020-11-20T11:28:13.003 INFO:teuthology.orchestra.run.smithi105.stdout: filestore flush min = 0 2020-11-20T11:28:13.003 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:28:13.003 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2020-11-20T11:28:13.004 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:28:13.004 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:28:13.004 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2020-11-20T11:28:13.004 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2020-11-20T11:28:13.004 INFO:teuthology.orchestra.run.smithi105.stdout: osd shutdown pgref assert = True 2020-11-20T11:28:13.005 INFO:teuthology.orchestra.run.smithi105.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:28:13.005 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.005 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2020-11-20T11:28:13.005 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-11-20T11:28:13.005 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2020-11-20T11:28:13.006 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2020-11-20T11:28:13.006 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2020-11-20T11:28:13.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:13.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:13.006 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2020-11-20T11:28:13.007 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.007 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2020-11-20T11:28:13.007 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-11-20T11:28:13.007 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2020-11-20T11:28:13.007 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2020-11-20T11:28:13.008 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2020-11-20T11:28:13.008 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2020-11-20T11:28:13.008 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2020-11-20T11:28:13.008 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:13.008 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2020-11-20T11:28:13.009 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2020-11-20T11:28:13.009 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:13.009 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2020-11-20T11:28:13.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:28:13.009 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2020-11-20T11:28:13.010 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2020-11-20T11:28:13.010 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2020-11-20T11:28:13.010 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2020-11-20T11:28:13.010 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:28:13.010 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:28:13.011 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2020-11-20T11:28:13.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2020-11-20T11:28:13.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-11-20T11:28:13.011 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 15m 2020-11-20T11:28:13.011 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 15m 2020-11-20T11:28:13.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2020-11-20T11:28:13.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2020-11-20T11:28:13.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2020-11-20T11:28:13.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2020-11-20T11:28:13.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2020-11-20T11:28:13.013 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2020-11-20T11:28:13.013 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2020-11-20T11:28:13.013 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2020-11-20T11:28:13.013 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-11-20T11:28:13.013 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal frag = True 2020-11-20T11:28:13.014 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal fragment size max = 10000 2020-11-20T11:28:13.014 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal merge size = 5 2020-11-20T11:28:13.014 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split bits = 3 2020-11-20T11:28:13.014 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split size = 100 2020-11-20T11:28:13.014 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2020-11-20T11:28:13.015 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2020-11-20T11:28:13.015 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2020-11-20T11:28:13.015 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2020-11-20T11:28:13.015 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2020-11-20T11:28:13.015 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 15m 2020-11-20T11:28:13.016 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 15m 2020-11-20T11:28:13.016 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2020-11-20T11:28:13.016 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2020-11-20T11:28:13.016 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:28:13.017 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2020-11-20T11:28:13.017 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.017 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2020-11-20T11:28:13.017 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.018 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2020-11-20T11:28:13.018 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.018 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2020-11-20T11:28:13.018 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2020-11-20T11:28:13.018 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.019 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2020-11-20T11:28:13.019 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2020-11-20T11:28:13.019 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.019 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:28:13.019 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2020-11-20T11:28:13.020 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.020 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:28:13.020 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:28:13.020 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.020 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2020-11-20T11:28:13.021 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.021 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2020-11-20T11:28:13.021 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2020-11-20T11:28:13.021 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:28:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:28:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2020-11-20T11:28:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:28:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2020-11-20T11:28:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:28:13.023 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:28:13.023 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2020-11-20T11:28:13.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.023 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:28:13.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.024 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2020-11-20T11:28:13.024 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.024 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2020-11-20T11:28:13.024 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.024 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2020-11-20T11:28:13.025 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2020-11-20T11:28:13.025 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2020-11-20T11:28:13.025 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.105,172.21.15.100,172.21.15.67" 2020-11-20T11:28:13.025 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = 6db90bc8-73b8-4163-bb1f-2d88eda44265 2020-11-20T11:28:13.025 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.026 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2020-11-20T11:28:13.026 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2020-11-20T11:28:13.026 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.026 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2020-11-20T11:28:13.027 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2020-11-20T11:28:13.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.027 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2020-11-20T11:28:13.027 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2020-11-20T11:28:13.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.028 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2020-11-20T11:28:13.028 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2020-11-20T11:28:13.028 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2020-11-20T11:28:13.028 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.028 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2020-11-20T11:28:13.029 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2020-11-20T11:28:13.029 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.029 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:28:13.029 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.029 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2020-11-20T11:28:13.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.030 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2020-11-20T11:28:13.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.030 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:28:13.030 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2020-11-20T11:28:13.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.031 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2020-11-20T11:28:13.031 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2020-11-20T11:28:13.031 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2020-11-20T11:28:13.031 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2020-11-20T11:28:13.032 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2020-11-20T11:28:13.032 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2020-11-20T11:28:13.032 INFO:teuthology.orchestra.run.smithi067.stdout: debug filestore = 20 2020-11-20T11:28:13.032 INFO:teuthology.orchestra.run.smithi067.stdout: debug journal = 20 2020-11-20T11:28:13.032 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 20 2020-11-20T11:28:13.033 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 25 2020-11-20T11:28:13.033 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2020-11-20T11:28:13.033 INFO:teuthology.orchestra.run.smithi067.stdout: filestore flush min = 0 2020-11-20T11:28:13.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:28:13.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2020-11-20T11:28:13.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:28:13.034 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:28:13.034 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2020-11-20T11:28:13.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2020-11-20T11:28:13.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd shutdown pgref assert = True 2020-11-20T11:28:13.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:28:13.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.036 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2020-11-20T11:28:13.036 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2020-11-20T11:28:13.036 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2020-11-20T11:28:13.036 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2020-11-20T11:28:13.036 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2020-11-20T11:28:13.037 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:13.037 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:13.037 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2020-11-20T11:28:13.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.037 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2020-11-20T11:28:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2020-11-20T11:28:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2020-11-20T11:28:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2020-11-20T11:28:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2020-11-20T11:28:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2020-11-20T11:28:13.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2020-11-20T11:28:13.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:28:13.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2020-11-20T11:28:13.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2020-11-20T11:28:13.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:28:13.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2020-11-20T11:28:13.040 INFO:teuthology.orchestra.run.smithi067.stdout: 2020-11-20T11:28:13.040 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2020-11-20T11:28:13.040 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2020-11-20T11:28:13.040 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2020-11-20T11:28:13.041 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2020-11-20T11:28:13.041 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:28:13.041 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:28:13.041 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2020-11-20T11:28:13.042 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2020-11-20T11:28:13.042 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2020-11-20T11:28:13.042 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 15m 2020-11-20T11:28:13.042 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 15m 2020-11-20T11:28:13.042 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2020-11-20T11:28:13.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2020-11-20T11:28:13.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2020-11-20T11:28:13.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2020-11-20T11:28:13.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2020-11-20T11:28:13.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2020-11-20T11:28:13.044 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2020-11-20T11:28:13.044 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2020-11-20T11:28:13.044 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2020-11-20T11:28:13.044 INFO:teuthology.orchestra.run.smithi067.stdout: mds bal frag = True 2020-11-20T11:28:13.044 INFO:teuthology.orchestra.run.smithi067.stdout: mds bal fragment size max = 10000 2020-11-20T11:28:13.045 INFO:teuthology.orchestra.run.smithi067.stdout: mds bal merge size = 5 2020-11-20T11:28:13.045 INFO:teuthology.orchestra.run.smithi067.stdout: mds bal split bits = 3 2020-11-20T11:28:13.045 INFO:teuthology.orchestra.run.smithi067.stdout: mds bal split size = 100 2020-11-20T11:28:13.045 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2020-11-20T11:28:13.045 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2020-11-20T11:28:13.046 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2020-11-20T11:28:13.046 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2020-11-20T11:28:13.046 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2020-11-20T11:28:13.046 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 15m 2020-11-20T11:28:13.046 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 15m 2020-11-20T11:28:13.047 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T11:28:13.047 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T11:28:13.151 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T11:28:13.151 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:13.151 INFO:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:28:13.166 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:28:13.168 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.] 2020-11-20T11:28:13.168 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBMqLdf1qpuExAA5DymqznJShD5g1RIpvxDvA== 2020-11-20T11:28:13.168 INFO:teuthology.orchestra.run.smithi105.stdout:[client.admin] 2020-11-20T11:28:13.168 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdflYQvBhAAMkEfiJXbGiqxZcIEYsvdOg== 2020-11-20T11:28:13.169 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow *" 2020-11-20T11:28:13.169 INFO:teuthology.orchestra.run.smithi105.stdout: caps mgr = "allow *" 2020-11-20T11:28:13.169 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow *" 2020-11-20T11:28:13.169 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow *" 2020-11-20T11:28:13.169 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:13.170 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:13.170 INFO:teuthology.orchestra.run.smithi105.stderr:206 bytes copied, 3.3099e-05 s, 6.2 MB/s 2020-11-20T11:28:13.170 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:13.171 INFO:teuthology.orchestra.run.smithi105:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:28:13.224 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:28:13.225 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:13.225 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:13.226 INFO:teuthology.orchestra.run.smithi105.stderr:409 bytes copied, 3.3676e-05 s, 12.1 MB/s 2020-11-20T11:28:13.226 INFO:teuthology.orchestra.run.smithi105.stdout: �m� �s�Ac�-���BeL��_ɥ�L��_ɥ��aXa �i��ibXb �d��dcXc �C��Cabc 2020-11-20T11:28:13.226 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:28:13.227 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:13.227 INFO:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.228 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.280 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.362 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:13.362 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:13.363 INFO:teuthology.orchestra.run.smithi105.stderr:206 bytes copied, 7.0983e-05 s, 2.9 MB/s 2020-11-20T11:28:13.363 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.379 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:13.379 INFO:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.394 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.461 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:13.462 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:13.462 INFO:teuthology.orchestra.run.smithi105.stderr:409 bytes copied, 0.0666311 s, 6.1 kB/s 2020-11-20T11:28:13.462 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:28:13.463 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:13.463 INFO:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.463 INFO:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.479 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.493 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:13.494 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:13.494 INFO:teuthology.orchestra.run.smithi100.stderr:206 bytes copied, 3.0143e-05 s, 6.8 MB/s 2020-11-20T11:28:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.509 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:13.510 INFO:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:409 bytes copied, 3.1428e-05 s, 13.0 MB/s 2020-11-20T11:28:13.565 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:28:13.566 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:13.566 INFO:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.567 INFO:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:28:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:13.603 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:13.603 INFO:teuthology.orchestra.run.smithi067.stderr:206 bytes copied, 3.1404e-05 s, 6.6 MB/s 2020-11-20T11:28:13.603 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:28:13.622 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:13.622 INFO:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:13.678 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:13.678 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:409 bytes copied, 3.7896e-05 s, 10.8 MB/s 2020-11-20T11:28:13.679 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T11:28:13.679 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T11:28:13.680 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:28:13.740 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:28:13.743 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:28:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:28:13.813 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:28:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:28:13.897 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T11:28:13.898 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:28:13.959 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:28:13.961 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T11:28:13.989 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:28:14.048 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:28:14.050 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T11:28:14.078 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:28:14.151 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:28:14.155 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T11:28:14.191 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T11:28:14.191 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T11:28:14.246 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T11:28:14.262 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T11:28:14.262 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:28:14.263 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T11:28:14.296 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:14.296 INFO:tasks.ceph:role: osd.0 2020-11-20T11:28:14.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:28:14.297 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:28:14.838 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:14.839 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:14.839 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:14.839 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-11-20T11:28:14.839 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:14.840 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:14.840 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:14.840 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:14.840 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:14.840 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:14.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-11-20T11:28:14.842 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T11:28:14.980 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T11:28:15.014 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T11:28:15.082 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:15.083 INFO:tasks.ceph:role: osd.3 2020-11-20T11:28:15.083 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:28:15.084 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:28:15.590 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:15.590 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:15.590 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:15.591 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-11-20T11:28:15.591 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:15.591 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:15.591 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:15.591 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:15.592 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:15.592 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:15.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-11-20T11:28:15.593 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T11:28:15.640 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T11:28:15.676 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T11:28:15.759 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:15.759 INFO:tasks.ceph:role: osd.6 2020-11-20T11:28:15.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:28:15.760 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:28:16.294 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:16.294 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:16.295 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:16.295 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-11-20T11:28:16.296 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:16.296 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:16.296 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:16.297 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:16.297 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:16.298 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:16.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-11-20T11:28:16.300 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T11:28:16.372 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T11:28:16.402 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T11:28:16.469 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:16.469 INFO:tasks.ceph:role: osd.9 2020-11-20T11:28:16.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:28:16.470 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:28:17.013 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:17.013 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:17.013 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:17.013 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-11-20T11:28:17.014 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:17.014 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:17.014 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:17.014 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:17.015 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:17.015 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:17.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-11-20T11:28:17.016 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T11:28:17.095 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T11:28:17.126 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:17.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.207+0000 7f8dc2720ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T11:28:17.213 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.210+0000 7f8dc2720ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T11:28:17.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.210+0000 7f8dc2720ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:28:17.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.210+0000 7f8dc2720ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:28:17.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.210+0000 7f8dc2720ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:28:17.217 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:17.215+0000 7f8dc2720ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T11:28:20.060 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T11:28:20.143 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:20.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.234+0000 7fe0f1d5eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T11:28:20.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.234+0000 7fe0f1d5eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T11:28:20.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.234+0000 7fe0f1d5eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:28:20.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.234+0000 7fe0f1d5eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:28:20.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.234+0000 7fe0f1d5eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:28:20.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:20.235+0000 7fe0f1d5eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T11:28:23.088 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T11:28:23.120 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:23.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.206+0000 7f6abe478ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T11:28:23.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.206+0000 7f6abe478ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T11:28:23.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.206+0000 7f6abe478ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:28:23.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.207+0000 7f6abe478ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:28:23.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.207+0000 7f6abe478ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:28:23.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:23.207+0000 7f6abe478ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T11:28:26.052 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T11:28:26.084 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:26.172 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.170+0000 7f3f48fecec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T11:28:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.170+0000 7f3f48fecec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T11:28:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.170+0000 7f3f48fecec0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:28:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.170+0000 7f3f48fecec0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:28:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.170+0000 7f3f48fecec0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:28:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:28:26.171+0000 7f3f48fecec0 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2020-11-20T11:28:29.032 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T11:28:29.074 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T11:28:29.122 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:29.124 INFO:tasks.ceph:role: osd.1 2020-11-20T11:28:29.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:28:29.126 INFO:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:28:29.661 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:29.661 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:29.661 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:29.662 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2020-11-20T11:28:29.662 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:29.662 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:29.662 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:29.663 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:29.663 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:29.663 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:29.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2020-11-20T11:28:29.665 INFO:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T11:28:29.778 INFO:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T11:28:29.813 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T11:28:29.883 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:29.883 INFO:tasks.ceph:role: osd.4 2020-11-20T11:28:29.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:28:29.884 INFO:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:28:30.398 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:30.398 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:30.399 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:30.399 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2020-11-20T11:28:30.399 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:30.399 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:30.399 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:30.400 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:30.400 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:30.400 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:30.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2020-11-20T11:28:30.401 INFO:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T11:28:30.455 INFO:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T11:28:30.505 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T11:28:30.584 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:30.585 INFO:tasks.ceph:role: osd.7 2020-11-20T11:28:30.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:28:30.586 INFO:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:28:31.141 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:31.142 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:31.142 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:31.142 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2020-11-20T11:28:31.142 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:31.143 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:31.143 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:31.143 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:31.143 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:31.143 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:31.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2020-11-20T11:28:31.145 INFO:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T11:28:31.218 INFO:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T11:28:31.255 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T11:28:31.328 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:31.329 INFO:tasks.ceph:role: osd.10 2020-11-20T11:28:31.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:28:31.330 INFO:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:28:31.862 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:31.862 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:31.862 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:31.862 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2020-11-20T11:28:31.863 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:31.863 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:31.863 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:31.863 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:31.863 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:31.864 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:31.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2020-11-20T11:28:31.865 INFO:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T11:28:31.957 INFO:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T11:28:31.993 INFO:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.082+0000 7f073c441ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T11:28:32.087 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.085+0000 7f073c441ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T11:28:32.087 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.085+0000 7f073c441ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:28:32.088 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.085+0000 7f073c441ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:28:32.088 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.085+0000 7f073c441ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:28:32.089 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:32.087+0000 7f073c441ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T11:28:34.937 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T11:28:34.970 INFO:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.060+0000 7f5edf1cdec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T11:28:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.060+0000 7f5edf1cdec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T11:28:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.060+0000 7f5edf1cdec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:28:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.060+0000 7f5edf1cdec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:28:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.060+0000 7f5edf1cdec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:28:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:35.061+0000 7f5edf1cdec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T11:28:37.911 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T11:28:37.944 INFO:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.032+0000 7f177a898ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T11:28:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.032+0000 7f177a898ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T11:28:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.032+0000 7f177a898ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:28:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.032+0000 7f177a898ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:28:38.036 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.032+0000 7f177a898ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:28:38.036 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:38.033+0000 7f177a898ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T11:28:40.880 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T11:28:40.911 INFO:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T11:28:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T11:28:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:28:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:28:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:28:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2020-11-20T11:28:40.996+0000 7f7ecc169ec0 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2020-11-20T11:28:41.143 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:41.146 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:41.148 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:43.839 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T11:28:43.871 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T11:28:43.908 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:43.908 INFO:tasks.ceph:role: osd.2 2020-11-20T11:28:43.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:28:43.909 INFO:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:28:44.439 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:44.439 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:44.439 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:44.440 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2020-11-20T11:28:44.440 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:44.440 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:44.440 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:44.440 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:44.441 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:44.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2020-11-20T11:28:44.442 INFO:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T11:28:44.560 INFO:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T11:28:44.599 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T11:28:44.673 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:44.673 INFO:tasks.ceph:role: osd.5 2020-11-20T11:28:44.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:28:44.674 INFO:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:28:45.187 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:45.187 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:45.187 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:45.187 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2020-11-20T11:28:45.188 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:45.188 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:45.188 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:45.188 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:45.189 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:45.189 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:45.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2020-11-20T11:28:45.190 INFO:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T11:28:45.242 INFO:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T11:28:45.279 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T11:28:45.351 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:45.352 INFO:tasks.ceph:role: osd.8 2020-11-20T11:28:45.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:28:45.353 INFO:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:28:45.883 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:45.883 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:45.883 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:45.883 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2020-11-20T11:28:45.884 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:45.884 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:45.884 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:45.884 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:45.884 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:45.885 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:45.885 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2020-11-20T11:28:45.886 INFO:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T11:28:45.971 INFO:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T11:28:46.008 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T11:28:46.080 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:28:46.081 INFO:tasks.ceph:role: osd.11 2020-11-20T11:28:46.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:28:46.081 INFO:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:28:46.613 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:28:46.613 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:28:46.613 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:28:46.614 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2020-11-20T11:28:46.614 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:28:46.614 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:28:46.614 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:28:46.614 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:28:46.615 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:28:46.615 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:28:46.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2020-11-20T11:28:46.616 INFO:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T11:28:46.728 INFO:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T11:28:46.765 INFO:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:46.858 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.854+0000 7ff14a342ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T11:28:46.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.857+0000 7ff14a342ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T11:28:46.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.857+0000 7ff14a342ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:28:46.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.857+0000 7ff14a342ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:28:46.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.857+0000 7ff14a342ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:28:46.862 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:46.859+0000 7ff14a342ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T11:28:49.715 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T11:28:49.751 INFO:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:49.845 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.841+0000 7fdb6527aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T11:28:49.845 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.841+0000 7fdb6527aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T11:28:49.845 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.841+0000 7fdb6527aec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:28:49.845 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.841+0000 7fdb6527aec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:28:49.846 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.841+0000 7fdb6527aec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:28:49.846 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:49.842+0000 7fdb6527aec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T11:28:52.688 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T11:28:52.727 INFO:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.825+0000 7f3d345c5ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T11:28:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.825+0000 7f3d345c5ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T11:28:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.825+0000 7f3d345c5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:28:52.835 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.826+0000 7f3d345c5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:28:52.836 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.826+0000 7f3d345c5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:28:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:52.826+0000 7f3d345c5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2020-11-20T11:28:55.677 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T11:28:55.713 INFO:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:28:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.804+0000 7fbef607aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T11:28:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.804+0000 7fbef607aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T11:28:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.804+0000 7fbef607aec0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:28:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.804+0000 7fbef607aec0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:28:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.804+0000 7fbef607aec0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:28:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:28:55.805+0000 7fbef607aec0 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2020-11-20T11:28:58.664 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T11:28:58.700 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T11:28:58.700 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:58.701 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:28:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:28:58.731 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2020-11-20T11:28:58.731 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdf70QMLBAAjU7CTSB2y0s7kgCtcAAyhw== 2020-11-20T11:28:58.732 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:58.732 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:58.732 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 6.2737e-05 s, 893 kB/s 2020-11-20T11:28:58.733 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:58.733 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:28:58.787 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:28:58.801 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2020-11-20T11:28:58.802 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdfsTwPORAAncLFJKbwFYrdF/wE5I1Jeg== 2020-11-20T11:28:58.802 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:58.802 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:58.802 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 3.9983e-05 s, 1.4 MB/s 2020-11-20T11:28:58.803 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:58.804 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:28:58.857 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:28:58.870 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2020-11-20T11:28:58.871 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBRqLdfjBhkDBAAeXVIdqK/4dG86KtVLclO/A== 2020-11-20T11:28:58.871 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:58.871 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:58.872 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 3.0794e-05 s, 1.8 MB/s 2020-11-20T11:28:58.872 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:58.873 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:28:58.927 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:28:58.940 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2020-11-20T11:28:58.940 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBUqLdf5bv7DRAA+nQIEdRYAtz5zwkzbn3FfA== 2020-11-20T11:28:58.941 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:58.941 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:58.941 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 3.028e-05 s, 1.8 MB/s 2020-11-20T11:28:58.942 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:58.942 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:28:58.996 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:28:59.009 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2020-11-20T11:28:59.009 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBXqLdfnP5WDBAAw9PsDJCJiGJMlhEZCLV7nA== 2020-11-20T11:28:59.009 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:59.009 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:59.010 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 3.161e-05 s, 1.8 MB/s 2020-11-20T11:28:59.011 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:59.011 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:28:59.066 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:28:59.079 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.9] 2020-11-20T11:28:59.080 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBaqLdf2C0sChAAD1bSDP+WMUxRdf580XEafQ== 2020-11-20T11:28:59.080 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:59.081 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:59.081 INFO:teuthology.orchestra.run.smithi105.stderr:56 bytes copied, 3.9025e-05 s, 1.4 MB/s 2020-11-20T11:28:59.082 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.083 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:28:59.099 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:28:59.113 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2020-11-20T11:28:59.113 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBNqLdf044+MBAAO13MPwoxBb/51eIyl84MSg== 2020-11-20T11:28:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:56 bytes copied, 4.3726e-05 s, 1.3 MB/s 2020-11-20T11:28:59.115 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.115 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:28:59.170 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:28:59.184 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2020-11-20T11:28:59.185 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBOqLdfIcjAAhAA7v2dMSy9qtOZc+PYM7ipMQ== 2020-11-20T11:28:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:56 bytes copied, 4.3513e-05 s, 1.3 MB/s 2020-11-20T11:28:59.186 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.187 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:28:59.241 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:28:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2020-11-20T11:28:59.255 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBgqLdf0Nv0BBAAvD+zU4AvUN1AUNtreNw8rg== 2020-11-20T11:28:59.255 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.255 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.256 INFO:teuthology.orchestra.run.smithi100.stderr:56 bytes copied, 3.2862e-05 s, 1.7 MB/s 2020-11-20T11:28:59.257 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.257 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:28:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:28:59.324 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2020-11-20T11:28:59.325 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBjqLdfUj+jAxAAIEz6dpgOII95i+ewlau6Sw== 2020-11-20T11:28:59.325 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.325 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.326 INFO:teuthology.orchestra.run.smithi100.stderr:56 bytes copied, 5.017e-05 s, 1.1 MB/s 2020-11-20T11:28:59.326 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.327 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:28:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:28:59.394 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2020-11-20T11:28:59.394 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBmqLdfaXzzARAA7LBQ3+r8bGSoCHlvleDS1A== 2020-11-20T11:28:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:56 bytes copied, 3.0026e-05 s, 1.9 MB/s 2020-11-20T11:28:59.396 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:28:59.396 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:28:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:28:59.462 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.10] 2020-11-20T11:28:59.463 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoqLdfmNhoOxAAYKGmtcJH1RE+zi7oFg/LHA== 2020-11-20T11:28:59.463 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:28:59.463 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:28:59.463 INFO:teuthology.orchestra.run.smithi100.stderr:57 bytes copied, 4.0675e-05 s, 1.4 MB/s 2020-11-20T11:28:59.464 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.465 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:28:59.500 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.z] 2020-11-20T11:28:59.500 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBNqLdfcOZFNRAACV48ao+Hx32nCGnjaCw1DA== 2020-11-20T11:28:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:56 bytes copied, 4.6868e-05 s, 1.2 MB/s 2020-11-20T11:28:59.502 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.502 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:28:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:28:59.590 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2020-11-20T11:28:59.594 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBOqLdfOSjtCBAAlFAWfIYHKTKWv9TyIz8S0Q== 2020-11-20T11:28:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.597 INFO:teuthology.orchestra.run.smithi067.stderr:56 bytes copied, 4.442e-05 s, 1.3 MB/s 2020-11-20T11:28:59.599 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.600 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:28:59.665 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:28:59.685 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2020-11-20T11:28:59.685 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBuqLdfKdQKMxAATXHnRo6jnHmqjdvYADgdOQ== 2020-11-20T11:28:59.686 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.686 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.686 INFO:teuthology.orchestra.run.smithi067.stderr:56 bytes copied, 3.9079e-05 s, 1.4 MB/s 2020-11-20T11:28:59.687 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.687 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:28:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:28:59.767 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2020-11-20T11:28:59.768 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBxqLdfByg+MhAAWzkr+CRc7779p8x5UY7Wpg== 2020-11-20T11:28:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:56 bytes copied, 3.6489e-05 s, 1.5 MB/s 2020-11-20T11:28:59.770 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.771 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:28:59.831 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:28:59.848 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.8] 2020-11-20T11:28:59.849 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB0qLdfmOhOMRAAEQrOMTi/xDDgq8zmU8/X5Q== 2020-11-20T11:28:59.849 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.849 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.850 INFO:teuthology.orchestra.run.smithi067.stderr:56 bytes copied, 3.7179e-05 s, 1.5 MB/s 2020-11-20T11:28:59.851 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:28:59.851 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:28:59.909 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:28:59.927 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.11] 2020-11-20T11:28:59.928 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB3qLdfu1b8LxAAbKdhz9v938dWh+xzyifzBw== 2020-11-20T11:28:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:28:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:28:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:57 bytes copied, 3.6056e-05 s, 1.6 MB/s 2020-11-20T11:28:59.930 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:28:59.930 INFO:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:28:59.952 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:28:59.953 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:28:59.954 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:28:59.954 INFO:teuthology.orchestra.run.smithi105.stderr:59 bytes copied, 3.5442e-05 s, 1.7 MB/s 2020-11-20T11:28:59.954 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2020-11-20T11:28:59.955 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBOqLdfjJ1/DhAABDSeetuCtU/9RxVuAUY0ng== 2020-11-20T11:28:59.955 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T11:28:59.955 INFO:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:28:59.976 INFO:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:28:59.979 INFO:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:29:00.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2020-11-20T11:29:00.006 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBNqLdf70QMLBAAjU7CTSB2y0s7kgCtcAAyhw== 2020-11-20T11:29:00.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2020-11-20T11:29:00.006 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBNqLdfsTwPORAAncLFJKbwFYrdF/wE5I1Jeg== 2020-11-20T11:29:00.007 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2020-11-20T11:29:00.007 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBRqLdfjBhkDBAAeXVIdqK/4dG86KtVLclO/A== 2020-11-20T11:29:00.007 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2020-11-20T11:29:00.007 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBUqLdf5bv7DRAA+nQIEdRYAtz5zwkzbn3FfA== 2020-11-20T11:29:00.008 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2020-11-20T11:29:00.008 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBXqLdfnP5WDBAAw9PsDJCJiGJMlhEZCLV7nA== 2020-11-20T11:29:00.008 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.9] 2020-11-20T11:29:00.008 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBaqLdf2C0sChAAD1bSDP+WMUxRdf580XEafQ== 2020-11-20T11:29:00.008 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2020-11-20T11:29:00.009 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBNqLdf044+MBAAO13MPwoxBb/51eIyl84MSg== 2020-11-20T11:29:00.009 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2020-11-20T11:29:00.009 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBOqLdfIcjAAhAA7v2dMSy9qtOZc+PYM7ipMQ== 2020-11-20T11:29:00.009 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2020-11-20T11:29:00.009 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBgqLdf0Nv0BBAAvD+zU4AvUN1AUNtreNw8rg== 2020-11-20T11:29:00.010 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2020-11-20T11:29:00.010 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBjqLdfUj+jAxAAIEz6dpgOII95i+ewlau6Sw== 2020-11-20T11:29:00.010 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2020-11-20T11:29:00.010 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBmqLdfaXzzARAA7LBQ3+r8bGSoCHlvleDS1A== 2020-11-20T11:29:00.011 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.10] 2020-11-20T11:29:00.011 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBoqLdfmNhoOxAAYKGmtcJH1RE+zi7oFg/LHA== 2020-11-20T11:29:00.011 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.z] 2020-11-20T11:29:00.011 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBNqLdfcOZFNRAACV48ao+Hx32nCGnjaCw1DA== 2020-11-20T11:29:00.011 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2020-11-20T11:29:00.012 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBOqLdfOSjtCBAAlFAWfIYHKTKWv9TyIz8S0Q== 2020-11-20T11:29:00.012 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2020-11-20T11:29:00.012 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBuqLdfKdQKMxAATXHnRo6jnHmqjdvYADgdOQ== 2020-11-20T11:29:00.012 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2020-11-20T11:29:00.012 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBxqLdfByg+MhAAWzkr+CRc7779p8x5UY7Wpg== 2020-11-20T11:29:00.013 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.8] 2020-11-20T11:29:00.013 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB0qLdfmOhOMRAAEQrOMTi/xDDgq8zmU8/X5Q== 2020-11-20T11:29:00.013 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.11] 2020-11-20T11:29:00.013 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB3qLdfu1b8LxAAbKdhz9v938dWh+xzyifzBw== 2020-11-20T11:29:00.014 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2020-11-20T11:29:00.014 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBOqLdfjJ1/DhAABDSeetuCtU/9RxVuAUY0ng== 2020-11-20T11:29:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2020-11-20T11:29:00.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBNqLdf70QMLBAAjU7CTSB2y0s7kgCtcAAyhw== 2020-11-20T11:29:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2020-11-20T11:29:00.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBNqLdfsTwPORAAncLFJKbwFYrdF/wE5I1Jeg== 2020-11-20T11:29:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2020-11-20T11:29:00.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBRqLdfjBhkDBAAeXVIdqK/4dG86KtVLclO/A== 2020-11-20T11:29:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2020-11-20T11:29:00.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBUqLdf5bv7DRAA+nQIEdRYAtz5zwkzbn3FfA== 2020-11-20T11:29:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2020-11-20T11:29:00.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBXqLdfnP5WDBAAw9PsDJCJiGJMlhEZCLV7nA== 2020-11-20T11:29:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.9] 2020-11-20T11:29:00.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBaqLdf2C0sChAAD1bSDP+WMUxRdf580XEafQ== 2020-11-20T11:29:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2020-11-20T11:29:00.018 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBNqLdf044+MBAAO13MPwoxBb/51eIyl84MSg== 2020-11-20T11:29:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2020-11-20T11:29:00.018 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBOqLdfIcjAAhAA7v2dMSy9qtOZc+PYM7ipMQ== 2020-11-20T11:29:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2020-11-20T11:29:00.019 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBgqLdf0Nv0BBAAvD+zU4AvUN1AUNtreNw8rg== 2020-11-20T11:29:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2020-11-20T11:29:00.019 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBjqLdfUj+jAxAAIEz6dpgOII95i+ewlau6Sw== 2020-11-20T11:29:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2020-11-20T11:29:00.019 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBmqLdfaXzzARAA7LBQ3+r8bGSoCHlvleDS1A== 2020-11-20T11:29:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.10] 2020-11-20T11:29:00.020 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoqLdfmNhoOxAAYKGmtcJH1RE+zi7oFg/LHA== 2020-11-20T11:29:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.z] 2020-11-20T11:29:00.020 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBNqLdfcOZFNRAACV48ao+Hx32nCGnjaCw1DA== 2020-11-20T11:29:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2020-11-20T11:29:00.021 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBOqLdfOSjtCBAAlFAWfIYHKTKWv9TyIz8S0Q== 2020-11-20T11:29:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2020-11-20T11:29:00.021 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBuqLdfKdQKMxAATXHnRo6jnHmqjdvYADgdOQ== 2020-11-20T11:29:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2020-11-20T11:29:00.022 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBxqLdfByg+MhAAWzkr+CRc7779p8x5UY7Wpg== 2020-11-20T11:29:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.8] 2020-11-20T11:29:00.022 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQB0qLdfmOhOMRAAEQrOMTi/xDDgq8zmU8/X5Q== 2020-11-20T11:29:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.11] 2020-11-20T11:29:00.022 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQB3qLdfu1b8LxAAbKdhz9v938dWh+xzyifzBw== 2020-11-20T11:29:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2020-11-20T11:29:00.023 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBOqLdfjJ1/DhAABDSeetuCtU/9RxVuAUY0ng== 2020-11-20T11:29:00.026 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2020-11-20T11:29:00.027 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdf70QMLBAAjU7CTSB2y0s7kgCtcAAyhw== 2020-11-20T11:29:00.027 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2020-11-20T11:29:00.027 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdfsTwPORAAncLFJKbwFYrdF/wE5I1Jeg== 2020-11-20T11:29:00.027 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2020-11-20T11:29:00.028 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBRqLdfjBhkDBAAeXVIdqK/4dG86KtVLclO/A== 2020-11-20T11:29:00.028 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2020-11-20T11:29:00.028 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBUqLdf5bv7DRAA+nQIEdRYAtz5zwkzbn3FfA== 2020-11-20T11:29:00.028 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2020-11-20T11:29:00.028 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBXqLdfnP5WDBAAw9PsDJCJiGJMlhEZCLV7nA== 2020-11-20T11:29:00.029 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.9] 2020-11-20T11:29:00.029 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBaqLdf2C0sChAAD1bSDP+WMUxRdf580XEafQ== 2020-11-20T11:29:00.029 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2020-11-20T11:29:00.029 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdf044+MBAAO13MPwoxBb/51eIyl84MSg== 2020-11-20T11:29:00.029 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2020-11-20T11:29:00.030 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBOqLdfIcjAAhAA7v2dMSy9qtOZc+PYM7ipMQ== 2020-11-20T11:29:00.030 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2020-11-20T11:29:00.030 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBgqLdf0Nv0BBAAvD+zU4AvUN1AUNtreNw8rg== 2020-11-20T11:29:00.030 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2020-11-20T11:29:00.031 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBjqLdfUj+jAxAAIEz6dpgOII95i+ewlau6Sw== 2020-11-20T11:29:00.031 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2020-11-20T11:29:00.031 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBmqLdfaXzzARAA7LBQ3+r8bGSoCHlvleDS1A== 2020-11-20T11:29:00.031 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.10] 2020-11-20T11:29:00.031 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBoqLdfmNhoOxAAYKGmtcJH1RE+zi7oFg/LHA== 2020-11-20T11:29:00.032 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.z] 2020-11-20T11:29:00.032 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBNqLdfcOZFNRAACV48ao+Hx32nCGnjaCw1DA== 2020-11-20T11:29:00.032 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2020-11-20T11:29:00.032 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBOqLdfOSjtCBAAlFAWfIYHKTKWv9TyIz8S0Q== 2020-11-20T11:29:00.032 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2020-11-20T11:29:00.033 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBuqLdfKdQKMxAATXHnRo6jnHmqjdvYADgdOQ== 2020-11-20T11:29:00.033 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2020-11-20T11:29:00.033 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBxqLdfByg+MhAAWzkr+CRc7779p8x5UY7Wpg== 2020-11-20T11:29:00.033 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.8] 2020-11-20T11:29:00.033 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB0qLdfmOhOMRAAEQrOMTi/xDDgq8zmU8/X5Q== 2020-11-20T11:29:00.034 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.11] 2020-11-20T11:29:00.034 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB3qLdfu1b8LxAAbKdhz9v938dWh+xzyifzBw== 2020-11-20T11:29:00.034 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2020-11-20T11:29:00.034 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBOqLdfjJ1/DhAABDSeetuCtU/9RxVuAUY0ng== 2020-11-20T11:29:00.035 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.064 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.070 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.133 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.138 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.142 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.197 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.200 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.202 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.253 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.255 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.258 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.306 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.310 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.312 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.361 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.366 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.369 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.418 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.421 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.423 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.471 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.474 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.476 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.528 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.531 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.534 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.582 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.585 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.587 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.636 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.638 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.640 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.689 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.691 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.694 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.742 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.745 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.747 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:29:00.795 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.798 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.801 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:29:00.852 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.855 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.858 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.906 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.910 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.912 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.962 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.964 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:00.967 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:01.016 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:01.018 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:01.020 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:29:01.069 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:29:01.083 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:29:01.096 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:29:01.988 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T11:29:01.989 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T11:29:02.033 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:29:02.148 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T11:29:02.181 INFO:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T11:29:02.219 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:29:02.326 INFO:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T11:29:02.360 INFO:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T11:29:02.401 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:29:02.511 INFO:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T11:29:02.544 INFO:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:29:02.587 INFO:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:29:02.589 INFO:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:29:02.603 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T11:29:02.603 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T11:29:02.604 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T11:29:02.645 INFO:tasks.ceph.mon.a:Started 2020-11-20T11:29:02.646 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T11:29:02.647 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T11:29:02.650 INFO:tasks.ceph.mon.b:Started 2020-11-20T11:29:02.650 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T11:29:02.651 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T11:29:02.653 INFO:tasks.ceph.mon.c:Started 2020-11-20T11:29:02.654 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T11:29:02.654 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T11:29:02.654 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T11:29:02.656 INFO:tasks.ceph.mgr.x:Started 2020-11-20T11:29:02.657 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T11:29:02.657 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T11:29:02.659 INFO:tasks.ceph.mgr.y:Started 2020-11-20T11:29:02.660 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T11:29:02.660 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T11:29:02.662 INFO:tasks.ceph.mgr.z:Started 2020-11-20T11:29:02.662 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T11:29:02.663 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T11:29:02.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.787+0000 7fe3a677a700 1 Processor -- start 2020-11-20T11:29:02.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.787+0000 7fe3a677a700 1 -- start start 2020-11-20T11:29:02.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a677a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:02.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a677a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:02.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a677a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a014fb00 con 0x7fe3a0062f70 2020-11-20T11:29:02.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a677a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a014f8e0 con 0x7fe3a00bdd10 2020-11-20T11:29:02.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a677a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a0025b00 con 0x7fe3a014ef90 2020-11-20T11:29:02.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:02.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40802/0 (socket says 172.21.15.105:40802) 2020-11-20T11:29:02.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 learned_addr learned my addr 172.21.15.105:0/4059071252 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:02.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe39f7fe700 1 --1- 172.21.15.105:0/4059071252 >> v1:172.21.15.105:6789/0 conn(0x7fe3a0062f70 0x7fe3a00bf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40406/0 (socket says 172.21.15.105:40406) 2020-11-20T11:29:02.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:02.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:02.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:02.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:29:02.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.788+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:02.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.789+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:29:02.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.789+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:02.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.789+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:02.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.789+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:29:02.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:02.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:29:02.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:02.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:02.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:29:02.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:02.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:02.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:02.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:02.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:02.990+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:29:03.396 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:03.397 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:03.397 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:03.398 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:03.398 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:29:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:29:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:03.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:03.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:03.391+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:29:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:04.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:29:04.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:04.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:04.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:29:04.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:04.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:04.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe39ffff700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:04.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:04.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:04.193+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:29:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 msgr2=0x7fe3a014f3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:29:05.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.105:3300/0 conn(0x7fe3a014ef90 0x7fe3a014f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:05.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 msgr2=0x7fe3a00be0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:29:05.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.67:3300/0 conn(0x7fe3a00bdd10 0x7fe3a00be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:05.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 >> v1:172.21.15.105:6789/0 conn(0x7fe3a0062f70 legacy=0x7fe3a00bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:05.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:05.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0025da0 con 0x7fe3800033d0 2020-11-20T11:29:05.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38000e9a0 con 0x7fe3800070c0 2020-11-20T11:29:05.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.789+0000 7fe39dffb700 1 -- 172.21.15.105:0/4059071252 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a014f8e0 con 0x7fe38000ae20 2020-11-20T11:29:05.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.790+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.790+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.790+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.790+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.790+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:29:05.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.991+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:05.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.991+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:05.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.991+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:05.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.991+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:05.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:05.991+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:29:06.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:06.392+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:06.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:06.392+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:06.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:06.392+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:06.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:06.392+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:06.396 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:06.392+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:29:07.196 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.193+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.196 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.194+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:29:07.197 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.194+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:29:07.197 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.194+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:29:07.197 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.194+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:29:07.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.818+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386287192 0 0) 0x7fe3a0025da0 con 0x7fe3800033d0 2020-11-20T11:29:07.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.818+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe38c003240 con 0x7fe3800033d0 2020-11-20T11:29:07.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.819+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616481235 0 0) 0x7fe38000e9a0 con 0x7fe3800070c0 2020-11-20T11:29:07.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.819+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a0025da0 con 0x7fe3800070c0 2020-11-20T11:29:07.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.819+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1883650430 0 0) 0x7fe38c003240 con 0x7fe3800033d0 2020-11-20T11:29:07.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 msgr2=0x7fe38000d2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:29:07.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 --2- 172.21.15.105:0/4059071252 >> v2:172.21.15.100:3300/0 conn(0x7fe38000ae20 0x7fe38000d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 >> v1:172.21.15.100:6789/0 conn(0x7fe3800070c0 legacy=0x7fe380009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380014090 con 0x7fe3800033d0 2020-11-20T11:29:07.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fe39000d1c0 con 0x7fe3800033d0 2020-11-20T11:29:07.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe3a4d17700 1 -- 172.21.15.105:0/4059071252 reap_dead start 2020-11-20T11:29:07.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 >> v1:172.21.15.67:6789/0 conn(0x7fe3800033d0 legacy=0x7fe380005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 0x7fe38c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 0x7fe38c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 0x7fe38c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a014f8e0 con 0x7fe38c003910 2020-11-20T11:29:07.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c00bc50 con 0x7fe38c004ea0 2020-11-20T11:29:07.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c00be10 con 0x7fe38c0044e0 2020-11-20T11:29:07.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 0x7fe38c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 0x7fe38c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 0x7fe38c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 -- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 msgr2=0x7fe38c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:07.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 0x7fe38c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 -- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 msgr2=0x7fe38c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:07.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 0x7fe38c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39f7fe700 1 -- 172.21.15.105:0/4059071252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c003240 con 0x7fe38c0044e0 2020-11-20T11:29:07.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 0x7fe38c00b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:07.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.820+0000 7fe39ffff700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 0x7fe38c003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:07.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.821+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 0x7fe38c004960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe38000acd0 tx=0x7fe394007b60).ready entity=mon.2 client_cookie=8dfea6785ace2587 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:07.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.821+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394007170 con 0x7fe38c0044e0 2020-11-20T11:29:07.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.821+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3940072d0 con 0x7fe38c0044e0 2020-11-20T11:29:07.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.821+0000 7fe39effd700 1 -- 172.21.15.105:0/4059071252 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400ca40 con 0x7fe38c0044e0 2020-11-20T11:29:07.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 -- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 msgr2=0x7fe38c004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 0x7fe38c004960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe38000acd0 tx=0x7fe394007b60).stop 2020-11-20T11:29:07.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 -- 172.21.15.105:0/4059071252 shutdown_connections 2020-11-20T11:29:07.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c0044e0 0x7fe38c004960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c003910 0x7fe38c003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 --2- 172.21.15.105:0/4059071252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38c004ea0 0x7fe38c00b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 -- 172.21.15.105:0/4059071252 >> 172.21.15.105:0/4059071252 conn(0x7fe3a00c4500 msgr2=0x7fe3a00c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:07.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 -- 172.21.15.105:0/4059071252 shutdown_connections 2020-11-20T11:29:07.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.822+0000 7fe3a677a700 1 -- 172.21.15.105:0/4059071252 wait complete. 2020-11-20T11:29:07.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.824+0000 7fe3a677a700 1 Processor -- start 2020-11-20T11:29:07.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.825+0000 7fe3a677a700 1 -- start start 2020-11-20T11:29:07.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.825+0000 7fe3a677a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.825+0000 7fe3a677a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a677a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 0x7fe3a01425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:07.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a677a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a015c130 con 0x7fe38c0044e0 2020-11-20T11:29:07.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a677a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a015c3d0 con 0x7fe3800033d0 2020-11-20T11:29:07.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a677a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a015c670 con 0x7fe38c003910 2020-11-20T11:29:07.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59002/0 (socket says 172.21.15.105:59002) 2020-11-20T11:29:07.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39ffff700 1 -- 172.21.15.105:0/1961170005 learned_addr learned my addr 172.21.15.105:0/1961170005 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:07.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40876/0 (socket says 172.21.15.105:40876) 2020-11-20T11:29:07.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 0x7fe3a01425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:07.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 -- 172.21.15.105:0/1961170005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 msgr2=0x7fe3a00c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 -- 172.21.15.105:0/1961170005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 msgr2=0x7fe3a01425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 0x7fe3a01425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 -- 172.21.15.105:0/1961170005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a015c910 con 0x7fe38c003910 2020-11-20T11:29:07.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39ffff700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:07.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe3a4d17700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 0x7fe3a01425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:07.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.826+0000 7fe39f7fe700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe394012000 tx=0x7fe394015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:07.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394004b70 con 0x7fe38c003910 2020-11-20T11:29:07.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394004cf0 con 0x7fe38c003910 2020-11-20T11:29:07.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a015cbb0 con 0x7fe38c003910 2020-11-20T11:29:07.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394014660 con 0x7fe38c003910 2020-11-20T11:29:07.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0145920 con 0x7fe38c003910 2020-11-20T11:29:07.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe394010030 con 0x7fe38c003910 2020-11-20T11:29:07.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.827+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe394028770 con 0x7fe38c003910 2020-11-20T11:29:07.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.829+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a00be680 con 0x7fe38c003910 2020-11-20T11:29:07.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.831+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe39401a070 con 0x7fe38c003910 2020-11-20T11:29:07.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.916+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe3a0044f60 con 0x7fe38c003910 2020-11-20T11:29:07.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.920+0000 7fe37ffff700 1 -- 172.21.15.105:0/1961170005 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe394004e60 con 0x7fe38c003910 2020-11-20T11:29:07.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 msgr2=0x7fe3a014dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:07.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe394012000 tx=0x7fe394015000).stop 2020-11-20T11:29:07.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 shutdown_connections 2020-11-20T11:29:07.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe38c0044e0 0x7fe3a01425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800033d0 0x7fe3a00c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 --2- 172.21.15.105:0/1961170005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe38c003910 0x7fe3a014dee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:07.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.921+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 >> 172.21.15.105:0/1961170005 conn(0x7fe3a00c4500 msgr2=0x7fe3a0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:07.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.922+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 shutdown_connections 2020-11-20T11:29:07.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:07.922+0000 7fe3a677a700 1 -- 172.21.15.105:0/1961170005 wait complete. 2020-11-20T11:29:07.926 INFO:teuthology.orchestra.run.smithi105.stderr:adjusted tunables profile to default 2020-11-20T11:29:07.936 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T11:29:07.937 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:29:07.937 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:29:07.951 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:29:07.965 INFO:teuthology.orchestra.run.smithi105.stdout:28d43528-bc7d-4336-babc-9ce77f2ae383 2020-11-20T11:29:07.965 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:29:07.965 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:29:07.966 INFO:teuthology.orchestra.run.smithi105.stderr:37 bytes copied, 3.3004e-05 s, 1.1 MB/s 2020-11-20T11:29:07.966 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:29:07.967 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:29:08.020 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:29:08.033 INFO:teuthology.orchestra.run.smithi105.stdout:c357fd9e-720f-4506-be55-66203d14795f 2020-11-20T11:29:08.034 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:29:08.034 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:29:08.034 INFO:teuthology.orchestra.run.smithi105.stderr:37 bytes copied, 4.7483e-05 s, 779 kB/s 2020-11-20T11:29:08.035 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:29:08.036 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:29:08.089 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:29:08.102 INFO:teuthology.orchestra.run.smithi105.stdout:fa80daf6-1797-44dc-8250-13bc57cca5ef 2020-11-20T11:29:08.103 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:29:08.103 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:29:08.103 INFO:teuthology.orchestra.run.smithi105.stderr:37 bytes copied, 3.2973e-05 s, 1.1 MB/s 2020-11-20T11:29:08.104 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:29:08.104 INFO:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:29:08.157 INFO:teuthology.orchestra.run.smithi105.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:29:08.170 INFO:teuthology.orchestra.run.smithi105.stdout:a0e37a56-69a2-40a9-b41b-45b4a78c33db 2020-11-20T11:29:08.171 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2020-11-20T11:29:08.171 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2020-11-20T11:29:08.171 INFO:teuthology.orchestra.run.smithi105.stderr:37 bytes copied, 5.1261e-05 s, 722 kB/s 2020-11-20T11:29:08.172 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:29:08.172 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:29:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:29:08.200 INFO:teuthology.orchestra.run.smithi100.stdout:0b365517-f0cd-4335-93eb-fa43988e7352 2020-11-20T11:29:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:29:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:29:08.201 INFO:teuthology.orchestra.run.smithi100.stderr:37 bytes copied, 3.3076e-05 s, 1.1 MB/s 2020-11-20T11:29:08.201 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:29:08.201 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:29:08.254 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:29:08.267 INFO:teuthology.orchestra.run.smithi100.stdout:6a97c7c7-350b-45a5-8edc-814ed52b9075 2020-11-20T11:29:08.268 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:29:08.268 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:29:08.268 INFO:teuthology.orchestra.run.smithi100.stderr:37 bytes copied, 3.4215e-05 s, 1.1 MB/s 2020-11-20T11:29:08.269 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:29:08.270 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:29:08.288 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:29:08.301 INFO:teuthology.orchestra.run.smithi100.stdout:8c824435-0b62-404e-ac4f-ace3021c8d49 2020-11-20T11:29:08.301 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:29:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:29:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:37 bytes copied, 3.2879e-05 s, 1.1 MB/s 2020-11-20T11:29:08.303 INFO:teuthology.orchestra.run.smithi100:> set -ex 2020-11-20T11:29:08.303 INFO:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:29:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:29:08.371 INFO:teuthology.orchestra.run.smithi100.stdout:fbedbd4f-e258-4b85-a402-39224f5f7eaa 2020-11-20T11:29:08.371 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2020-11-20T11:29:08.371 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2020-11-20T11:29:08.372 INFO:teuthology.orchestra.run.smithi100.stderr:37 bytes copied, 3.2066e-05 s, 1.2 MB/s 2020-11-20T11:29:08.373 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:29:08.373 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:29:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:29:08.410 INFO:teuthology.orchestra.run.smithi067.stdout:1ab5b2be-91c2-49b4-ac74-3c03369154f7 2020-11-20T11:29:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:29:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:29:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:37 bytes copied, 3.5969e-05 s, 1.0 MB/s 2020-11-20T11:29:08.414 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:29:08.415 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:29:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:29:08.482 INFO:teuthology.orchestra.run.smithi067.stdout:82292b9b-38f8-4a3b-adad-4b2973cff1e5 2020-11-20T11:29:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:29:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:29:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:37 bytes copied, 3.7058e-05 s, 998 kB/s 2020-11-20T11:29:08.484 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:29:08.484 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:29:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:29:08.560 INFO:teuthology.orchestra.run.smithi067.stdout:94f71992-cb21-4ce6-85b6-a8f9d04cbfef 2020-11-20T11:29:08.561 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:29:08.561 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:29:08.561 INFO:teuthology.orchestra.run.smithi067.stderr:37 bytes copied, 3.5289e-05 s, 1.0 MB/s 2020-11-20T11:29:08.562 INFO:teuthology.orchestra.run.smithi067:> set -ex 2020-11-20T11:29:08.562 INFO:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:29:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:29:08.636 INFO:teuthology.orchestra.run.smithi067.stdout:1a3c1bdf-8b24-456f-ae61-0c982d2c21dc 2020-11-20T11:29:08.636 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2020-11-20T11:29:08.636 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2020-11-20T11:29:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:37 bytes copied, 4.218e-05 s, 877 kB/s 2020-11-20T11:29:08.638 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 28d43528-bc7d-4336-babc-9ce77f2ae383 0 2020-11-20T11:29:08.809 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.803+0000 7fbc94b17700 1 Processor -- start 2020-11-20T11:29:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.803+0000 7fbc94b17700 1 -- start start 2020-11-20T11:29:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc94b17700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc90025c20 0x7fbc900c5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc94b17700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc9014e380 0x7fbc9014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc94b17700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc90062f70 con 0x7fbc90026000 2020-11-20T11:29:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc94b17700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900bbd70 con 0x7fbc9014e380 2020-11-20T11:29:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc94b17700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900be9c0 con 0x7fbc90025c20 2020-11-20T11:29:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc9014e380 0x7fbc9014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc9014e380 0x7fbc9014e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37178/0 (socket says 172.21.15.67:37178) 2020-11-20T11:29:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8ed9d700 1 -- 172.21.15.67:0/415963410 learned_addr learned my addr 172.21.15.67:0/415963410 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8e59c700 1 --2- 172.21.15.67:0/415963410 >> v2:172.21.15.100:3300/0 conn(0x7fbc90025c20 0x7fbc900c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8ed9d700 1 -- 172.21.15.67:0/415963410 >> v2:172.21.15.100:3300/0 conn(0x7fbc90025c20 msgr2=0x7fbc900c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.804+0000 7fbc8ed9d700 1 --2- 172.21.15.67:0/415963410 >> v2:172.21.15.100:3300/0 conn(0x7fbc90025c20 0x7fbc900c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8ed9d700 1 -- 172.21.15.67:0/415963410 >> v1:172.21.15.100:6789/0 conn(0x7fbc90026000 legacy=0x7fbc900bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8ed9d700 1 -- 172.21.15.67:0/415963410 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc901517e0 con 0x7fbc9014e380 2020-11-20T11:29:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8ed9d700 1 --2- 172.21.15.67:0/415963410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc9014e7f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbc9005efd0 tx=0x7fbc80009290).ready entity=mon.0 client_cookie=ef837cea04f1a175 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8d59a700 1 -- 172.21.15.67:0/415963410 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000bbc0 con 0x7fbc9014e380 2020-11-20T11:29:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8d59a700 1 -- 172.21.15.67:0/415963410 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8000bd20 con 0x7fbc9014e380 2020-11-20T11:29:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc8d59a700 1 -- 172.21.15.67:0/415963410 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80011610 con 0x7fbc9014e380 2020-11-20T11:29:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 -- 172.21.15.67:0/415963410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 msgr2=0x7fbc9014e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 --2- 172.21.15.67:0/415963410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc9014e7f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbc9005efd0 tx=0x7fbc80009290).stop 2020-11-20T11:29:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 -- 172.21.15.67:0/415963410 shutdown_connections 2020-11-20T11:29:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 --2- 172.21.15.67:0/415963410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc9014e7f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 --2- 172.21.15.67:0/415963410 >> v2:172.21.15.100:3300/0 conn(0x7fbc90025c20 0x7fbc900c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 -- 172.21.15.67:0/415963410 >> 172.21.15.67:0/415963410 conn(0x7fbc900c4520 msgr2=0x7fbc900c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 -- 172.21.15.67:0/415963410 shutdown_connections 2020-11-20T11:29:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.805+0000 7fbc94b17700 1 -- 172.21.15.67:0/415963410 wait complete. 2020-11-20T11:29:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.806+0000 7fbc94b17700 1 Processor -- start 2020-11-20T11:29:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 -- start start 2020-11-20T11:29:08.818 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:08.818 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc90026000 0x7fbc9014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:08.818 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:08.818 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90164a60 con 0x7fbc9014e380 2020-11-20T11:29:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90160800 con 0x7fbc90025c20 2020-11-20T11:29:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc94b17700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90160aa0 con 0x7fbc90026000 2020-11-20T11:29:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8ed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.67:36714/0 (socket says 172.21.15.67:36714) 2020-11-20T11:29:08.820 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8ed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37184/0 (socket says 172.21.15.67:37184) 2020-11-20T11:29:08.820 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8e59c700 1 -- 172.21.15.67:0/1934373340 learned_addr learned my addr 172.21.15.67:0/1934373340 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:08.820 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.807+0000 7fbc8dd9b700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc90026000 0x7fbc9014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:08.820 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 -- 172.21.15.67:0/1934373340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc90026000 msgr2=0x7fbc9014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:08.820 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc90026000 0x7fbc9014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 -- 172.21.15.67:0/1934373340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 msgr2=0x7fbc90152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 -- 172.21.15.67:0/1934373340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90160d40 con 0x7fbc90025c20 2020-11-20T11:29:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8ed9d700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc8e59c700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbc8800ec00 tx=0x7fbc88006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:08.822 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b8d0 con 0x7fbc90025c20 2020-11-20T11:29:08.822 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800ba30 con 0x7fbc90025c20 2020-11-20T11:29:08.822 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc90160fe0 con 0x7fbc90025c20 2020-11-20T11:29:08.822 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bdb0 con 0x7fbc90025c20 2020-11-20T11:29:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc90161520 con 0x7fbc90025c20 2020-11-20T11:29:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fbc88012860 con 0x7fbc90025c20 2020-11-20T11:29:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.808+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbc8801c7d0 con 0x7fbc90025c20 2020-11-20T11:29:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.809+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc90068d00 con 0x7fbc90025c20 2020-11-20T11:29:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.811+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fbc88012cd0 con 0x7fbc90025c20 2020-11-20T11:29:08.908 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.905+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28d43528-bc7d-4336-babc-9ce77f2ae383", "id": 0} v 0) v1 -- 0x7fbc9005d680 con 0x7fbc90025c20 2020-11-20T11:29:08.912 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc867fc700 1 -- 172.21.15.67:0/1934373340 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28d43528-bc7d-4336-babc-9ce77f2ae383", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc8801ca10 con 0x7fbc90025c20 2020-11-20T11:29:08.913 INFO:teuthology.orchestra.run.smithi067.stdout:0 2020-11-20T11:29:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 msgr2=0x7fbc90164570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbc8800ec00 tx=0x7fbc88006df0).stop 2020-11-20T11:29:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 shutdown_connections 2020-11-20T11:29:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc9014e380 0x7fbc90152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc90025c20 0x7fbc90164570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 --2- 172.21.15.67:0/1934373340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc90026000 0x7fbc9014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.910+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 >> 172.21.15.67:0/1934373340 conn(0x7fbc900c4520 msgr2=0x7fbc900bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.911+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 shutdown_connections 2020-11-20T11:29:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:08.911+0000 7fbc94b17700 1 -- 172.21.15.67:0/1934373340 wait complete. 2020-11-20T11:29:08.925 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 0b365517-f0cd-4335-93eb-fa43988e7352 1 2020-11-20T11:29:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.079+0000 7f0e044c1700 1 Processor -- start 2020-11-20T11:29:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.079+0000 7f0e044c1700 1 -- start start 2020-11-20T11:29:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e044c1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0dfc0bd350 0x7f0dfc161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e044c1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0bdc50 con 0x7f0dfc07f910 2020-11-20T11:29:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e044c1700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0be3f0 con 0x7f0dfc0ba6f0 2020-11-20T11:29:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e044c1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc062cf0 con 0x7f0dfc0bd350 2020-11-20T11:29:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e0225d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0dfc07f910 0x7f0dfc0625e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.67:36972/0 (socket says 172.21.15.67:36972) 2020-11-20T11:29:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.081+0000 7f0e0225d700 1 -- 172.21.15.67:0/1741812622 learned_addr learned my addr 172.21.15.67:0/1741812622 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.082+0000 7f0e02a5e700 1 --2- 172.21.15.67:0/1741812622 >> v2:172.21.15.67:3300/0 conn(0x7f0dfc0bd350 0x7f0dfc161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.082+0000 7f0e02a5e700 1 -- 172.21.15.67:0/1741812622 >> v1:172.21.15.105:6789/0 conn(0x7f0dfc0ba6f0 legacy=0x7f0dfc0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.082+0000 7f0e02a5e700 1 -- 172.21.15.67:0/1741812622 >> v1:172.21.15.100:6789/0 conn(0x7f0dfc07f910 legacy=0x7f0dfc0625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.088 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.082+0000 7f0e02a5e700 1 -- 172.21.15.67:0/1741812622 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0bdeb0 con 0x7f0dfc0bd350 2020-11-20T11:29:09.088 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.083+0000 7f0e02a5e700 1 --2- 172.21.15.67:0/1741812622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc161c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0dfc0be580 tx=0x7f0dec006df0).ready entity=mon.0 client_cookie=d9ec3b0ae083224 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.089 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.083+0000 7f0e0125b700 1 -- 172.21.15.67:0/1741812622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0096e0 con 0x7f0dfc0bd350 2020-11-20T11:29:09.089 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.083+0000 7f0e0125b700 1 -- 172.21.15.67:0/1741812622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec009840 con 0x7f0dfc0bd350 2020-11-20T11:29:09.090 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.083+0000 7f0e0125b700 1 -- 172.21.15.67:0/1741812622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec009bc0 con 0x7f0dfc0bd350 2020-11-20T11:29:09.090 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.084+0000 7f0e044c1700 1 -- 172.21.15.67:0/1741812622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0bd350 msgr2=0x7f0dfc161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.090 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.084+0000 7f0e044c1700 1 --2- 172.21.15.67:0/1741812622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc161c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0dfc0be580 tx=0x7f0dec006df0).stop 2020-11-20T11:29:09.093 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.085+0000 7f0e044c1700 1 -- 172.21.15.67:0/1741812622 shutdown_connections 2020-11-20T11:29:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.085+0000 7f0e044c1700 1 --2- 172.21.15.67:0/1741812622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc161c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.085+0000 7f0e044c1700 1 -- 172.21.15.67:0/1741812622 >> 172.21.15.67:0/1741812622 conn(0x7f0dfc025a60 msgr2=0x7f0dfc025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.085+0000 7f0e044c1700 1 -- 172.21.15.67:0/1741812622 shutdown_connections 2020-11-20T11:29:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.085+0000 7f0e044c1700 1 -- 172.21.15.67:0/1741812622 wait complete. 2020-11-20T11:29:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.087+0000 7f0e044c1700 1 Processor -- start 2020-11-20T11:29:09.101 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.087+0000 7f0e044c1700 1 -- start start 2020-11-20T11:29:09.101 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.101 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e0225d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.101 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e0225d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37192/0 (socket says 172.21.15.67:37192) 2020-11-20T11:29:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e0225d700 1 -- 172.21.15.67:0/386159929 learned_addr learned my addr 172.21.15.67:0/386159929 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dfc0ba6f0 0x7f0dfc0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c16a0 con 0x7f0dfc07f910 2020-11-20T11:29:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc15bb40 con 0x7f0dfc0ba6f0 2020-11-20T11:29:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.089+0000 7f0e044c1700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc16d4d0 con 0x7f0dfc0bd350 2020-11-20T11:29:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 -- 172.21.15.67:0/386159929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc0bd350 msgr2=0x7f0dfc0c2ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:29:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc0c2ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 -- 172.21.15.67:0/386159929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dfc0ba6f0 msgr2=0x7f0dfc0c39c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:29:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dfc0ba6f0 0x7f0dfc0c39c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc16d770 con 0x7f0dfc07f910 2020-11-20T11:29:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0e0225d700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0df400c630 tx=0x7f0df4009690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4006320 con 0x7f0dfc07f910 2020-11-20T11:29:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4010070 con 0x7f0dfc07f910 2020-11-20T11:29:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.090+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4006480 con 0x7f0dfc07f910 2020-11-20T11:29:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.091+0000 7f0e044c1700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc16da10 con 0x7f0dfc07f910 2020-11-20T11:29:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.091+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0df4016430 con 0x7f0dfc07f910 2020-11-20T11:29:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.091+0000 7f0e044c1700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc16df50 con 0x7f0dfc07f910 2020-11-20T11:29:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.091+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f0df4006ad0 con 0x7f0dfc07f910 2020-11-20T11:29:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.095+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc05ca10 con 0x7f0dfc07f910 2020-11-20T11:29:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.100+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f0df401b060 con 0x7f0dfc07f910 2020-11-20T11:29:09.197 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.194+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b365517-f0cd-4335-93eb-fa43988e7352", "id": 1} v 0) v1 -- 0x7f0dfc0c0820 con 0x7f0dfc07f910 2020-11-20T11:29:09.200 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.197+0000 7f0df27fc700 1 -- 172.21.15.67:0/386159929 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b365517-f0cd-4335-93eb-fa43988e7352", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0df40168f0 con 0x7f0dfc07f910 2020-11-20T11:29:09.200 INFO:teuthology.orchestra.run.smithi067.stdout:1 2020-11-20T11:29:09.201 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 msgr2=0x7f0dfc0c11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.201 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0df400c630 tx=0x7f0df4009690).stop 2020-11-20T11:29:09.202 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 shutdown_connections 2020-11-20T11:29:09.202 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc0bd350 0x7f0dfc0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:09.202 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc07f910 0x7f0dfc0c11b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.202 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 --2- 172.21.15.67:0/386159929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dfc0ba6f0 0x7f0dfc0c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 >> 172.21.15.67:0/386159929 conn(0x7f0dfc025a60 msgr2=0x7f0dfc15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 shutdown_connections 2020-11-20T11:29:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.198+0000 7f0dd7fff700 1 -- 172.21.15.67:0/386159929 wait complete. 2020-11-20T11:29:09.212 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 1ab5b2be-91c2-49b4-ac74-3c03369154f7 2 2020-11-20T11:29:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.335+0000 7f1ec5d22700 1 Processor -- start 2020-11-20T11:29:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.335+0000 7f1ec5d22700 1 -- start start 2020-11-20T11:29:09.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ec5d22700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ec0152020 0x7f1ec00be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ec5d22700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec014e2c0 con 0x7f1ec00c37a0 2020-11-20T11:29:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ec5d22700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec014e560 con 0x7f1ec00bdf50 2020-11-20T11:29:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ec5d22700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec014e800 con 0x7f1ec0152020 2020-11-20T11:29:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1ec00c37a0 0x7f1ec00c3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58990/0 (socket says 172.21.15.67:58990) 2020-11-20T11:29:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebffff700 1 -- 172.21.15.67:0/1376826841 learned_addr learned my addr 172.21.15.67:0/1376826841 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebeffd700 1 --2- 172.21.15.67:0/1376826841 >> v2:172.21.15.105:3300/0 conn(0x7f1ec0152020 0x7f1ec00be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158918834 0 0) 0x7f1ec014e2c0 con 0x7f1ec00c37a0 2020-11-20T11:29:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea0003240 con 0x7f1ec00c37a0 2020-11-20T11:29:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564888818 0 0) 0x7f1ec014e560 con 0x7f1ec00bdf50 2020-11-20T11:29:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec014e2c0 con 0x7f1ec00bdf50 2020-11-20T11:29:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebeffd700 1 -- 172.21.15.67:0/1376826841 >> v1:172.21.15.100:6789/0 conn(0x7f1ec00bdf50 legacy=0x7f1ec00ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.336+0000 7f1ebeffd700 1 -- 172.21.15.67:0/1376826841 >> v1:172.21.15.67:6789/0 conn(0x7f1ec00c37a0 legacy=0x7f1ec00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ebeffd700 1 -- 172.21.15.67:0/1376826841 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec014eaa0 con 0x7f1ec0152020 2020-11-20T11:29:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ebeffd700 1 --2- 172.21.15.67:0/1376826841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0152020 0x7f1ec00be330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1eb000b990 tx=0x7f1eb0006d90).ready entity=mon.2 client_cookie=a179deb30a32ab91 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0006030 con 0x7f1ec0152020 2020-11-20T11:29:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0006190 con 0x7f1ec0152020 2020-11-20T11:29:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ebe7fc700 1 -- 172.21.15.67:0/1376826841 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0006510 con 0x7f1ec0152020 2020-11-20T11:29:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 -- 172.21.15.67:0/1376826841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0152020 msgr2=0x7f1ec00be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/1376826841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0152020 0x7f1ec00be330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1eb000b990 tx=0x7f1eb0006d90).stop 2020-11-20T11:29:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 -- 172.21.15.67:0/1376826841 shutdown_connections 2020-11-20T11:29:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/1376826841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0152020 0x7f1ec00be330 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 -- 172.21.15.67:0/1376826841 >> 172.21.15.67:0/1376826841 conn(0x7f1ec00b9890 msgr2=0x7f1ec00b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 -- 172.21.15.67:0/1376826841 shutdown_connections 2020-11-20T11:29:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.337+0000 7f1ec5d22700 1 -- 172.21.15.67:0/1376826841 wait complete. 2020-11-20T11:29:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 Processor -- start 2020-11-20T11:29:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 -- start start 2020-11-20T11:29:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 0x7f1ec0164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0152020 0x7f1ec014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec014f8d0 con 0x7f1ec00c37a0 2020-11-20T11:29:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec014fb70 con 0x7f1ec0152020 2020-11-20T11:29:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.339+0000 7f1ec5d22700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0163e50 con 0x7f1ec00bdf50 2020-11-20T11:29:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 0x7f1ec0164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37202/0 (socket says 172.21.15.67:37202) 2020-11-20T11:29:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebeffd700 1 -- 172.21.15.67:0/476956707 learned_addr learned my addr 172.21.15.67:0/476956707 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebffff700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0152020 0x7f1ec014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 -- 172.21.15.67:0/476956707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0152020 msgr2=0x7f1ec014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0152020 0x7f1ec014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 -- 172.21.15.67:0/476956707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 msgr2=0x7f1ec0154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 -- 172.21.15.67:0/476956707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec01640f0 con 0x7f1ec00bdf50 2020-11-20T11:29:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebeffd700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ebf7fe700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 0x7f1ec0164830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1ea800c6e0 tx=0x7f1ea80079d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800e490 con 0x7f1ec00bdf50 2020-11-20T11:29:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea800e5f0 con 0x7f1ec00bdf50 2020-11-20T11:29:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec0164390 con 0x7f1ec00bdf50 2020-11-20T11:29:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800e990 con 0x7f1ec00bdf50 2020-11-20T11:29:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec014b3d0 con 0x7f1ec00bdf50 2020-11-20T11:29:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f1ea8019030 con 0x7f1ec00bdf50 2020-11-20T11:29:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.340+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f1ea801c440 con 0x7f1ec00bdf50 2020-11-20T11:29:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.341+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0044f60 con 0x7f1ec00bdf50 2020-11-20T11:29:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.343+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f1ea8017070 con 0x7f1ec00bdf50 2020-11-20T11:29:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.438+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ab5b2be-91c2-49b4-ac74-3c03369154f7", "id": 2} v 0) v1 -- 0x7f1ec00bd500 con 0x7f1ec00bdf50 2020-11-20T11:29:09.448 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.445+0000 7f1eb77fe700 1 -- 172.21.15.67:0/476956707 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ab5b2be-91c2-49b4-ac74-3c03369154f7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ea801c940 con 0x7f1ec00bdf50 2020-11-20T11:29:09.448 INFO:teuthology.orchestra.run.smithi067.stdout:2 2020-11-20T11:29:09.449 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 msgr2=0x7f1ec0164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.449 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 0x7f1ec0164830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1ea800c6e0 tx=0x7f1ea80079d0).stop 2020-11-20T11:29:09.450 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 shutdown_connections 2020-11-20T11:29:09.450 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0152020 0x7f1ec014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.450 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec00bdf50 0x7f1ec0164830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.450 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 --2- 172.21.15.67:0/476956707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec00c37a0 0x7f1ec0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.451 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 >> 172.21.15.67:0/476956707 conn(0x7f1ec00b9890 msgr2=0x7f1ec00650f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.451 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 shutdown_connections 2020-11-20T11:29:09.451 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.446+0000 7f1ec5d22700 1 -- 172.21.15.67:0/476956707 wait complete. 2020-11-20T11:29:09.461 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new c357fd9e-720f-4506-be55-66203d14795f 3 2020-11-20T11:29:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.585+0000 7ff745e8a700 1 Processor -- start 2020-11-20T11:29:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.585+0000 7ff745e8a700 1 -- start start 2020-11-20T11:29:09.590 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff745e8a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7400c78d0 0x7ff7400c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff745e8a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff740155650 con 0x7ff740066ec0 2020-11-20T11:29:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff745e8a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7401512d0 con 0x7ff74014e260 2020-11-20T11:29:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff745e8a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff740151570 con 0x7ff7400c78d0 2020-11-20T11:29:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff73f7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7400c78d0 0x7ff7400c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff73ffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff740066ec0 0x7ff740154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59002/0 (socket says 172.21.15.67:59002) 2020-11-20T11:29:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.586+0000 7ff73ffff700 1 -- 172.21.15.67:0/3758481001 learned_addr learned my addr 172.21.15.67:0/3758481001 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73f7fe700 1 -- 172.21.15.67:0/3758481001 >> v1:172.21.15.105:6789/0 conn(0x7ff74014e260 legacy=0x7ff7400667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73f7fe700 1 -- 172.21.15.67:0/3758481001 >> v1:172.21.15.67:6789/0 conn(0x7ff740066ec0 legacy=0x7ff740154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73e7fc700 1 -- 172.21.15.67:0/3758481001 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326746335 0 0) 0x7ff740155650 con 0x7ff740066ec0 2020-11-20T11:29:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73f7fe700 1 -- 172.21.15.67:0/3758481001 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740151810 con 0x7ff7400c78d0 2020-11-20T11:29:09.593 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73f7fe700 1 --2- 172.21.15.67:0/3758481001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7400c78d0 0x7ff7400c7cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff73000b9a0 tx=0x7ff730006df0).ready entity=mon.0 client_cookie=5bcfa67ecc3a827c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.593 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73e7fc700 1 -- 172.21.15.67:0/3758481001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730009840 con 0x7ff7400c78d0 2020-11-20T11:29:09.593 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73e7fc700 1 -- 172.21.15.67:0/3758481001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300099a0 con 0x7ff7400c78d0 2020-11-20T11:29:09.593 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff73e7fc700 1 -- 172.21.15.67:0/3758481001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730009d20 con 0x7ff7400c78d0 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.587+0000 7ff745e8a700 1 -- 172.21.15.67:0/3758481001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7400c78d0 msgr2=0x7ff7400c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 --2- 172.21.15.67:0/3758481001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7400c78d0 0x7ff7400c7cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff73000b9a0 tx=0x7ff730006df0).stop 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 -- 172.21.15.67:0/3758481001 shutdown_connections 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 --2- 172.21.15.67:0/3758481001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7400c78d0 0x7ff7400c7cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 -- 172.21.15.67:0/3758481001 >> 172.21.15.67:0/3758481001 conn(0x7ff7400bdca0 msgr2=0x7ff7400be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.594 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 -- 172.21.15.67:0/3758481001 shutdown_connections 2020-11-20T11:29:09.595 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.588+0000 7ff745e8a700 1 -- 172.21.15.67:0/3758481001 wait complete. 2020-11-20T11:29:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.589+0000 7ff745e8a700 1 Processor -- start 2020-11-20T11:29:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.589+0000 7ff745e8a700 1 -- start start 2020-11-20T11:29:09.598 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.598 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7400c78d0 0x7ff740160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.598 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 0x7ff740157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.598 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7401540a0 con 0x7ff740066ec0 2020-11-20T11:29:09.599 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c0800 con 0x7ff74014e260 2020-11-20T11:29:09.599 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c0aa0 con 0x7ff7400c78d0 2020-11-20T11:29:09.599 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.599 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37212/0 (socket says 172.21.15.67:37212) 2020-11-20T11:29:09.599 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 -- 172.21.15.67:0/2985938935 learned_addr learned my addr 172.21.15.67:0/2985938935 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73effd700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7400c78d0 0x7ff740160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73ffff700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 0x7ff740157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 -- 172.21.15.67:0/2985938935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7400c78d0 msgr2=0x7ff740160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7400c78d0 0x7ff740160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 -- 172.21.15.67:0/2985938935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 msgr2=0x7ff740157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 0x7ff740157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 -- 172.21.15.67:0/2985938935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400c0d40 con 0x7ff740066ec0 2020-11-20T11:29:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73ffff700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 0x7ff740157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff73f7fe700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff73000bf10 tx=0x7ff730015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730011e60 con 0x7ff740066ec0 2020-11-20T11:29:09.602 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73001d5d0 con 0x7ff740066ec0 2020-11-20T11:29:09.602 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff740160730 con 0x7ff740066ec0 2020-11-20T11:29:09.602 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.590+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73001d970 con 0x7ff740066ec0 2020-11-20T11:29:09.602 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.591+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7400beed0 con 0x7ff740066ec0 2020-11-20T11:29:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.591+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff730025030 con 0x7ff740066ec0 2020-11-20T11:29:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.591+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff73001ece0 con 0x7ff740066ec0 2020-11-20T11:29:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.591+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff740044f60 con 0x7ff740066ec0 2020-11-20T11:29:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.593+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ff730023070 con 0x7ff740066ec0 2020-11-20T11:29:09.690 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.688+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c357fd9e-720f-4506-be55-66203d14795f", "id": 3} v 0) v1 -- 0x7ff7400c4080 con 0x7ff740066ec0 2020-11-20T11:29:09.693 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.691+0000 7ff7377fe700 1 -- 172.21.15.67:0/2985938935 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c357fd9e-720f-4506-be55-66203d14795f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff730006980 con 0x7ff740066ec0 2020-11-20T11:29:09.694 INFO:teuthology.orchestra.run.smithi067.stdout:3 2020-11-20T11:29:09.695 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 msgr2=0x7ff740153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.695 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff73000bf10 tx=0x7ff730015000).stop 2020-11-20T11:29:09.695 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 shutdown_connections 2020-11-20T11:29:09.695 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff74014e260 0x7ff740157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff740066ec0 0x7ff740153bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 --2- 172.21.15.67:0/2985938935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7400c78d0 0x7ff740160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 >> 172.21.15.67:0/2985938935 conn(0x7ff7400bdca0 msgr2=0x7ff7400667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 shutdown_connections 2020-11-20T11:29:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.692+0000 7ff745e8a700 1 -- 172.21.15.67:0/2985938935 wait complete. 2020-11-20T11:29:09.706 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 6a97c7c7-350b-45a5-8edc-814ed52b9075 4 2020-11-20T11:29:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.832+0000 7f4b8b4f9700 1 Processor -- start 2020-11-20T11:29:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.832+0000 7f4b8b4f9700 1 -- start start 2020-11-20T11:29:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b8b4f9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4b840c1360 0x7f4b84154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b8b4f9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b840c0cf0 con 0x7f4b841548e0 2020-11-20T11:29:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b8b4f9700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b840668c0 con 0x7f4b841551b0 2020-11-20T11:29:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b8b4f9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b84155620 con 0x7f4b840c1360 2020-11-20T11:29:09.839 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b89295700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4b841548e0 0x7f4b84067540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59010/0 (socket says 172.21.15.67:59010) 2020-11-20T11:29:09.839 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b89295700 1 -- 172.21.15.67:0/3294031734 learned_addr learned my addr 172.21.15.67:0/3294031734 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:09.839 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.833+0000 7f4b88a94700 1 --2- 172.21.15.67:0/3294031734 >> v2:172.21.15.105:3300/0 conn(0x7f4b840c1360 0x7f4b84154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.839 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675246594 0 0) 0x7f4b840c0cf0 con 0x7f4b841548e0 2020-11-20T11:29:09.839 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b70003240 con 0x7f4b841548e0 2020-11-20T11:29:09.840 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421405583 0 0) 0x7f4b840668c0 con 0x7f4b841551b0 2020-11-20T11:29:09.840 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b840c0cf0 con 0x7f4b841551b0 2020-11-20T11:29:09.840 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b88a94700 1 -- 172.21.15.67:0/3294031734 >> v1:172.21.15.100:6789/0 conn(0x7f4b841551b0 legacy=0x7f4b841514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.840 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b88a94700 1 -- 172.21.15.67:0/3294031734 >> v1:172.21.15.67:6789/0 conn(0x7f4b841548e0 legacy=0x7f4b84067540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.840 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b88a94700 1 -- 172.21.15.67:0/3294031734 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84066b60 con 0x7f4b840c1360 2020-11-20T11:29:09.841 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b88a94700 1 --2- 172.21.15.67:0/3294031734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b840c1360 0x7f4b84154cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4b7800b9a0 tx=0x7f4b78006df0).ready entity=mon.2 client_cookie=4e68fab4e2a46e59 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.841 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009710 con 0x7f4b840c1360 2020-11-20T11:29:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78009870 con 0x7f4b840c1360 2020-11-20T11:29:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.834+0000 7f4b83fff700 1 -- 172.21.15.67:0/3294031734 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009bf0 con 0x7f4b840c1360 2020-11-20T11:29:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/3294031734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b840c1360 msgr2=0x7f4b84154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/3294031734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b840c1360 0x7f4b84154cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4b7800b9a0 tx=0x7f4b78006df0).stop 2020-11-20T11:29:09.843 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/3294031734 shutdown_connections 2020-11-20T11:29:09.843 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/3294031734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b840c1360 0x7f4b84154cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.843 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/3294031734 >> 172.21.15.67:0/3294031734 conn(0x7f4b84026530 msgr2=0x7f4b840c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.843 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/3294031734 shutdown_connections 2020-11-20T11:29:09.843 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.835+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/3294031734 wait complete. 2020-11-20T11:29:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.836+0000 7f4b8b4f9700 1 Processor -- start 2020-11-20T11:29:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.836+0000 7f4b8b4f9700 1 -- start start 2020-11-20T11:29:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.847 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b841548e0 0x7f4b84150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.847 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b841551b0 0x7f4b8414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:09.847 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84164870 con 0x7f4b840c1360 2020-11-20T11:29:09.847 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840bcbc0 con 0x7f4b841551b0 2020-11-20T11:29:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b8b4f9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841645d0 con 0x7f4b841548e0 2020-11-20T11:29:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37224/0 (socket says 172.21.15.67:37224) 2020-11-20T11:29:09.849 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 -- 172.21.15.67:0/287077272 learned_addr learned my addr 172.21.15.67:0/287077272 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:09.849 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b88a94700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b841548e0 0x7f4b84150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.849 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89a96700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b841551b0 0x7f4b8414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:09.849 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 -- 172.21.15.67:0/287077272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b841548e0 msgr2=0x7f4b84150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.849 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b841548e0 0x7f4b84150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 -- 172.21.15.67:0/287077272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b841551b0 msgr2=0x7f4b8414dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b841551b0 0x7f4b8414dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 -- 172.21.15.67:0/287077272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840bce20 con 0x7f4b840c1360 2020-11-20T11:29:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b89295700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4b7c002210 tx=0x7f4b7c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.837+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c005b80 con 0x7f4b840c1360 2020-11-20T11:29:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c005ce0 con 0x7f4b840c1360 2020-11-20T11:29:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c007320 con 0x7f4b840c1360 2020-11-20T11:29:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b840bd0c0 con 0x7f4b840c1360 2020-11-20T11:29:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b840bd800 con 0x7f4b840c1360 2020-11-20T11:29:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f4b7c010030 con 0x7f4b840c1360 2020-11-20T11:29:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.838+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f4b7c013410 con 0x7f4b840c1360 2020-11-20T11:29:09.853 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.839+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b840bd520 con 0x7f4b840c1360 2020-11-20T11:29:09.853 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.841+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f4b7c00a520 con 0x7f4b840c1360 2020-11-20T11:29:09.937 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.935+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a97c7c7-350b-45a5-8edc-814ed52b9075", "id": 4} v 0) v1 -- 0x7f4b84044f60 con 0x7f4b840c1360 2020-11-20T11:29:09.945 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.942+0000 7f4b817fa700 1 -- 172.21.15.67:0/287077272 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a97c7c7-350b-45a5-8edc-814ed52b9075", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b7c005e50 con 0x7f4b840c1360 2020-11-20T11:29:09.945 INFO:teuthology.orchestra.run.smithi067.stdout:4 2020-11-20T11:29:09.946 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 msgr2=0x7f4b84150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:09.946 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4b7c002210 tx=0x7f4b7c007ef0).stop 2020-11-20T11:29:09.947 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 shutdown_connections 2020-11-20T11:29:09.947 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b841551b0 0x7f4b8414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.947 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b840c1360 0x7f4b84150260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.947 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 --2- 172.21.15.67:0/287077272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b841548e0 0x7f4b84150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:09.947 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 >> 172.21.15.67:0/287077272 conn(0x7f4b84026530 msgr2=0x7f4b84151920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:09.948 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 shutdown_connections 2020-11-20T11:29:09.948 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:09.943+0000 7f4b8b4f9700 1 -- 172.21.15.67:0/287077272 wait complete. 2020-11-20T11:29:09.957 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 82292b9b-38f8-4a3b-adad-4b2973cff1e5 5 2020-11-20T11:29:10.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.081+0000 7f1d1e593700 1 Processor -- start 2020-11-20T11:29:10.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.081+0000 7f1d1e593700 1 -- start start 2020-11-20T11:29:10.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.081+0000 7f1d1e593700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1d18150d30 0x7f1d18151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d1e593700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d18151710 0x7f1d1809ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d1e593700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d18065060 con 0x7f1d180626f0 2020-11-20T11:29:10.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d1e593700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d18065300 con 0x7f1d18151710 2020-11-20T11:29:10.104 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d1e593700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180655a0 con 0x7f1d18150d30 2020-11-20T11:29:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d18151710 0x7f1d1809ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d18151710 0x7f1d1809ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37232/0 (socket says 172.21.15.67:37232) 2020-11-20T11:29:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 -- 172.21.15.67:0/1605370584 learned_addr learned my addr 172.21.15.67:0/1605370584 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d17fff700 1 --2- 172.21.15.67:0/1605370584 >> v2:172.21.15.105:3300/0 conn(0x7f1d18150d30 0x7f1d18151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 -- 172.21.15.67:0/1605370584 >> v2:172.21.15.105:3300/0 conn(0x7f1d18150d30 msgr2=0x7f1d18151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 --2- 172.21.15.67:0/1605370584 >> v2:172.21.15.105:3300/0 conn(0x7f1d18150d30 0x7f1d18151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 -- 172.21.15.67:0/1605370584 >> v1:172.21.15.100:6789/0 conn(0x7f1d180626f0 legacy=0x7f1d180667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 -- 172.21.15.67:0/1605370584 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18065840 con 0x7f1d18151710 2020-11-20T11:29:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d177fe700 1 --2- 172.21.15.67:0/1605370584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18151710 0x7f1d1809ad30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f1d18026e50 tx=0x7f1d0c006e50).ready entity=mon.0 client_cookie=15ffc7d73f336303 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d16ffd700 1 -- 172.21.15.67:0/1605370584 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c006030 con 0x7f1d18151710 2020-11-20T11:29:10.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d16ffd700 1 -- 172.21.15.67:0/1605370584 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c006190 con 0x7f1d18151710 2020-11-20T11:29:10.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.082+0000 7f1d16ffd700 1 -- 172.21.15.67:0/1605370584 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c006510 con 0x7f1d18151710 2020-11-20T11:29:10.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 -- 172.21.15.67:0/1605370584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18151710 msgr2=0x7f1d1809ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 --2- 172.21.15.67:0/1605370584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18151710 0x7f1d1809ad30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f1d18026e50 tx=0x7f1d0c006e50).stop 2020-11-20T11:29:10.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 -- 172.21.15.67:0/1605370584 shutdown_connections 2020-11-20T11:29:10.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 --2- 172.21.15.67:0/1605370584 >> v2:172.21.15.105:3300/0 conn(0x7f1d18150d30 0x7f1d18151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 --2- 172.21.15.67:0/1605370584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18151710 0x7f1d1809ad30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 -- 172.21.15.67:0/1605370584 >> 172.21.15.67:0/1605370584 conn(0x7f1d180b9890 msgr2=0x7f1d180b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 -- 172.21.15.67:0/1605370584 shutdown_connections 2020-11-20T11:29:10.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.083+0000 7f1d1e593700 1 -- 172.21.15.67:0/1605370584 wait complete. 2020-11-20T11:29:10.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.084+0000 7f1d1e593700 1 Processor -- start 2020-11-20T11:29:10.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.084+0000 7f1d1e593700 1 -- start start 2020-11-20T11:29:10.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d18150d30 0x7f1d1813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18151710 0x7f1d18160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18164880 con 0x7f1d180626f0 2020-11-20T11:29:10.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18160440 con 0x7f1d18150d30 2020-11-20T11:29:10.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1e593700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1813de30 con 0x7f1d18151710 2020-11-20T11:29:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37236/0 (socket says 172.21.15.67:37236) 2020-11-20T11:29:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 -- 172.21.15.67:0/2215491933 learned_addr learned my addr 172.21.15.67:0/2215491933 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d177fe700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d18150d30 0x7f1d1813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d1cb30700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18151710 0x7f1d18160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 -- 172.21.15.67:0/2215491933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18151710 msgr2=0x7f1d18160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18151710 0x7f1d18160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 -- 172.21.15.67:0/2215491933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d18150d30 msgr2=0x7f1d1813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d18150d30 0x7f1d1813d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.085+0000 7f1d17fff700 1 -- 172.21.15.67:0/2215491933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18149960 con 0x7f1d180626f0 2020-11-20T11:29:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1d17fff700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1d0800eba0 tx=0x7f1d08006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800c8e0 con 0x7f1d180626f0 2020-11-20T11:29:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0800ca40 con 0x7f1d180626f0 2020-11-20T11:29:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d18149c00 con 0x7f1d180626f0 2020-11-20T11:29:10.114 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800cdc0 con 0x7f1d180626f0 2020-11-20T11:29:10.114 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d18160670 con 0x7f1d180626f0 2020-11-20T11:29:10.114 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f1d08012860 con 0x7f1d180626f0 2020-11-20T11:29:10.114 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.086+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f1d0801ca10 con 0x7f1d180626f0 2020-11-20T11:29:10.114 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.087+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d18065a20 con 0x7f1d180626f0 2020-11-20T11:29:10.115 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.089+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f1d0801cd30 con 0x7f1d180626f0 2020-11-20T11:29:10.188 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.184+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82292b9b-38f8-4a3b-adad-4b2973cff1e5", "id": 5} v 0) v1 -- 0x7f1d18044f60 con 0x7f1d180626f0 2020-11-20T11:29:10.194 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.191+0000 7f1cf7fff700 1 -- 172.21.15.67:0/2215491933 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82292b9b-38f8-4a3b-adad-4b2973cff1e5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d08012c80 con 0x7f1d180626f0 2020-11-20T11:29:10.194 INFO:teuthology.orchestra.run.smithi067.stdout:5 2020-11-20T11:29:10.195 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 msgr2=0x7f1d18164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.196 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1d0800eba0 tx=0x7f1d08006df0).stop 2020-11-20T11:29:10.196 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 shutdown_connections 2020-11-20T11:29:10.196 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18151710 0x7f1d18160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.196 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d180626f0 0x7f1d18164390 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 --2- 172.21.15.67:0/2215491933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d18150d30 0x7f1d1813d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 >> 172.21.15.67:0/2215491933 conn(0x7f1d180b9890 msgr2=0x7f1d1814f320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 shutdown_connections 2020-11-20T11:29:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.192+0000 7f1d1e593700 1 -- 172.21.15.67:0/2215491933 wait complete. 2020-11-20T11:29:10.206 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new fa80daf6-1797-44dc-8250-13bc57cca5ef 6 2020-11-20T11:29:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.333+0000 7f68640ff700 1 Processor -- start 2020-11-20T11:29:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.333+0000 7f68640ff700 1 -- start start 2020-11-20T11:29:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f68640ff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f685c151710 0x7f685c151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f68640ff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c09b190 con 0x7f685c09ad30 2020-11-20T11:29:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f68640ff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c065060 con 0x7f685c150d30 2020-11-20T11:29:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f68640ff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c065300 con 0x7f685c151710 2020-11-20T11:29:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f686269c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f685c09ad30 0x7f685c0667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59038/0 (socket says 172.21.15.67:59038) 2020-11-20T11:29:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f686269c700 1 -- 172.21.15.67:0/3764254548 learned_addr learned my addr 172.21.15.67:0/3764254548 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f686169a700 1 --2- 172.21.15.67:0/3764254548 >> v2:172.21.15.105:3300/0 conn(0x7f685c151710 0x7f685c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f6860e99700 1 -- 172.21.15.67:0/3764254548 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280408148 0 0) 0x7f685c09b190 con 0x7f685c09ad30 2020-11-20T11:29:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.334+0000 7f6860e99700 1 -- 172.21.15.67:0/3764254548 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6848003240 con 0x7f685c09ad30 2020-11-20T11:29:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f686169a700 1 -- 172.21.15.67:0/3764254548 >> v1:172.21.15.105:6789/0 conn(0x7f685c150d30 legacy=0x7f685c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f686169a700 1 -- 172.21.15.67:0/3764254548 >> v1:172.21.15.67:6789/0 conn(0x7f685c09ad30 legacy=0x7f685c0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f686169a700 1 -- 172.21.15.67:0/3764254548 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0655a0 con 0x7f685c151710 2020-11-20T11:29:10.342 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f686169a700 1 --2- 172.21.15.67:0/3764254548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c151710 0x7f685c151110 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f685000b990 tx=0x7f6850006d90).ready entity=mon.2 client_cookie=b873fa2faa8fac45 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f6860e99700 1 -- 172.21.15.67:0/3764254548 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850006030 con 0x7f685c151710 2020-11-20T11:29:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f6860e99700 1 -- 172.21.15.67:0/3764254548 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850006190 con 0x7f685c151710 2020-11-20T11:29:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.335+0000 7f6860e99700 1 -- 172.21.15.67:0/3764254548 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850006510 con 0x7f685c151710 2020-11-20T11:29:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 -- 172.21.15.67:0/3764254548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c151710 msgr2=0x7f685c151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 --2- 172.21.15.67:0/3764254548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c151710 0x7f685c151110 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f685000b990 tx=0x7f6850006d90).stop 2020-11-20T11:29:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 -- 172.21.15.67:0/3764254548 shutdown_connections 2020-11-20T11:29:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 --2- 172.21.15.67:0/3764254548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c151710 0x7f685c151110 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 -- 172.21.15.67:0/3764254548 >> 172.21.15.67:0/3764254548 conn(0x7f685c0b9890 msgr2=0x7f685c0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 -- 172.21.15.67:0/3764254548 shutdown_connections 2020-11-20T11:29:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.336+0000 7f68640ff700 1 -- 172.21.15.67:0/3764254548 wait complete. 2020-11-20T11:29:10.355 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.337+0000 7f68640ff700 1 Processor -- start 2020-11-20T11:29:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.337+0000 7f68640ff700 1 -- start start 2020-11-20T11:29:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c09ad30 0x7f685c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f685c151710 0x7f685c149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1605a0 con 0x7f685c150d30 2020-11-20T11:29:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c160840 con 0x7f685c151710 2020-11-20T11:29:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c160ae0 con 0x7f685c09ad30 2020-11-20T11:29:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37248/0 (socket says 172.21.15.67:37248) 2020-11-20T11:29:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 -- 172.21.15.67:0/3169630060 learned_addr learned my addr 172.21.15.67:0/3169630060 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f6861e9b700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c09ad30 0x7f685c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686269c700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f685c151710 0x7f685c149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 -- 172.21.15.67:0/3169630060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c09ad30 msgr2=0x7f685c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c09ad30 0x7f685c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 -- 172.21.15.67:0/3169630060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f685c151710 msgr2=0x7f685c149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f685c151710 0x7f685c149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 -- 172.21.15.67:0/3169630060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c160d80 con 0x7f685c150d30 2020-11-20T11:29:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f686169a700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f685000bfb0 tx=0x7f6850016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500059b0 con 0x7f685c150d30 2020-11-20T11:29:10.360 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685001f070 con 0x7f685c150d30 2020-11-20T11:29:10.360 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c161020 con 0x7f685c150d30 2020-11-20T11:29:10.360 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.338+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850005b10 con 0x7f685c150d30 2020-11-20T11:29:10.360 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.339+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c149d00 con 0x7f685c150d30 2020-11-20T11:29:10.360 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.339+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f6850016070 con 0x7f685c150d30 2020-11-20T11:29:10.361 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.339+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f6850024a40 con 0x7f685c150d30 2020-11-20T11:29:10.361 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.340+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c1611b0 con 0x7f685c150d30 2020-11-20T11:29:10.361 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.342+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f6850014070 con 0x7f685c150d30 2020-11-20T11:29:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.448+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa80daf6-1797-44dc-8250-13bc57cca5ef", "id": 6} v 0) v1 -- 0x7f685c044f60 con 0x7f685c150d30 2020-11-20T11:29:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.455+0000 7f6859ffb700 1 -- 172.21.15.67:0/3169630060 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa80daf6-1797-44dc-8250-13bc57cca5ef", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6850018a10 con 0x7f685c150d30 2020-11-20T11:29:10.458 INFO:teuthology.orchestra.run.smithi067.stdout:6 2020-11-20T11:29:10.460 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 msgr2=0x7f685c14bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f685000bfb0 tx=0x7f6850016000).stop 2020-11-20T11:29:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 shutdown_connections 2020-11-20T11:29:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f685c151710 0x7f685c149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f685c09ad30 0x7f685c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 --2- 172.21.15.67:0/3169630060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f685c150d30 0x7f685c14bff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 >> 172.21.15.67:0/3169630060 conn(0x7f685c0b9890 msgr2=0x7f685c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 shutdown_connections 2020-11-20T11:29:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.456+0000 7f68640ff700 1 -- 172.21.15.67:0/3169630060 wait complete. 2020-11-20T11:29:10.475 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 8c824435-0b62-404e-ac4f-ace3021c8d49 7 2020-11-20T11:29:10.604 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.601+0000 7fab93a7e700 1 Processor -- start 2020-11-20T11:29:10.604 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.601+0000 7fab93a7e700 1 -- start start 2020-11-20T11:29:10.606 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab93a7e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 0x7fab8c151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.606 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab93a7e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab8c09ad30 0x7fab8c0667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.606 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab93a7e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c09b190 con 0x7fab8c150d30 2020-11-20T11:29:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab93a7e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c065060 con 0x7fab8c09ad30 2020-11-20T11:29:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab93a7e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c065300 con 0x7fab8c151710 2020-11-20T11:29:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab91019700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 0x7fab8c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab9201b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab8c09ad30 0x7fab8c0667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab91019700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 0x7fab8c151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.67:41092/0 (socket says 172.21.15.67:41092) 2020-11-20T11:29:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab91019700 1 -- 172.21.15.67:0/3515364375 learned_addr learned my addr 172.21.15.67:0/3515364375 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.602+0000 7fab9201b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab8c09ad30 0x7fab8c0667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.67:36790/0 (socket says 172.21.15.67:36790) 2020-11-20T11:29:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab9201b700 1 -- 172.21.15.67:0/3515364375 >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 msgr2=0x7fab8c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab9201b700 1 --2- 172.21.15.67:0/3515364375 >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 0x7fab8c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab9201b700 1 -- 172.21.15.67:0/3515364375 >> v1:172.21.15.105:6789/0 conn(0x7fab8c150d30 legacy=0x7fab8c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab9201b700 1 -- 172.21.15.67:0/3515364375 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0655a0 con 0x7fab8c09ad30 2020-11-20T11:29:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab9201b700 1 --2- 172.21.15.67:0/3515364375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c09ad30 0x7fab8c0667b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fab8c0682d0 tx=0x7fab88006df0).ready entity=mon.1 client_cookie=961be195a8815ce1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab90818700 1 -- 172.21.15.67:0/3515364375 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab880097b0 con 0x7fab8c09ad30 2020-11-20T11:29:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab90818700 1 -- 172.21.15.67:0/3515364375 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88009910 con 0x7fab8c09ad30 2020-11-20T11:29:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab90818700 1 -- 172.21.15.67:0/3515364375 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88009c90 con 0x7fab8c09ad30 2020-11-20T11:29:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 -- 172.21.15.67:0/3515364375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c09ad30 msgr2=0x7fab8c0667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 --2- 172.21.15.67:0/3515364375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c09ad30 0x7fab8c0667b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fab8c0682d0 tx=0x7fab88006df0).stop 2020-11-20T11:29:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 -- 172.21.15.67:0/3515364375 shutdown_connections 2020-11-20T11:29:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 --2- 172.21.15.67:0/3515364375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c09ad30 0x7fab8c0667b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 --2- 172.21.15.67:0/3515364375 >> v2:172.21.15.105:3300/0 conn(0x7fab8c151710 0x7fab8c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.603+0000 7fab93a7e700 1 -- 172.21.15.67:0/3515364375 >> 172.21.15.67:0/3515364375 conn(0x7fab8c0b9890 msgr2=0x7fab8c0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.604+0000 7fab93a7e700 1 -- 172.21.15.67:0/3515364375 shutdown_connections 2020-11-20T11:29:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.604+0000 7fab93a7e700 1 -- 172.21.15.67:0/3515364375 wait complete. 2020-11-20T11:29:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 Processor -- start 2020-11-20T11:29:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 -- start start 2020-11-20T11:29:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 0x7fab8c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 0x7fab8c160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c14cb40 con 0x7fab8c09ad30 2020-11-20T11:29:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c145500 con 0x7fab8c151710 2020-11-20T11:29:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab93a7e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1457a0 con 0x7fab8c150d30 2020-11-20T11:29:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.605+0000 7fab9181a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 0x7fab8c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab9181a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37258/0 (socket says 172.21.15.67:37258) 2020-11-20T11:29:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab9181a700 1 -- 172.21.15.67:0/4161824695 learned_addr learned my addr 172.21.15.67:0/4161824695 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab9201b700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 0x7fab8c160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 -- 172.21.15.67:0/4161824695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 msgr2=0x7fab8c160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 0x7fab8c160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 -- 172.21.15.67:0/4161824695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 msgr2=0x7fab8c14a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 -- 172.21.15.67:0/4161824695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c145a40 con 0x7fab8c150d30 2020-11-20T11:29:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab9181a700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab9201b700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 0x7fab8c160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab91019700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 0x7fab8c14c650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fab7c00ed60 tx=0x7fab7c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00bc80 con 0x7fab8c150d30 2020-11-20T11:29:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00bde0 con 0x7fab8c150d30 2020-11-20T11:29:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c160340 con 0x7fab8c150d30 2020-11-20T11:29:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c010670 con 0x7fab8c150d30 2020-11-20T11:29:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fab7c010cc0 con 0x7fab8c150d30 2020-11-20T11:29:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.606+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c160f70 con 0x7fab8c150d30 2020-11-20T11:29:10.624 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.607+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fab7c018e00 con 0x7fab8c150d30 2020-11-20T11:29:10.624 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.607+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c1607a0 con 0x7fab8c150d30 2020-11-20T11:29:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.609+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fab7c018770 con 0x7fab8c150d30 2020-11-20T11:29:10.705 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.703+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c824435-0b62-404e-ac4f-ace3021c8d49", "id": 7} v 0) v1 -- 0x7fab8c145bd0 con 0x7fab8c150d30 2020-11-20T11:29:10.713 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.710+0000 7fab79ffb700 1 -- 172.21.15.67:0/4161824695 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c824435-0b62-404e-ac4f-ace3021c8d49", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab7c018910 con 0x7fab8c150d30 2020-11-20T11:29:10.713 INFO:teuthology.orchestra.run.smithi067.stdout:7 2020-11-20T11:29:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 msgr2=0x7fab8c14c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.715 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 0x7fab8c14c650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fab7c00ed60 tx=0x7fab7c008040).stop 2020-11-20T11:29:10.715 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 shutdown_connections 2020-11-20T11:29:10.715 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab8c151710 0x7fab8c160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.715 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c09ad30 0x7fab8c14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 --2- 172.21.15.67:0/4161824695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab8c150d30 0x7fab8c14c650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 >> 172.21.15.67:0/4161824695 conn(0x7fab8c0b9890 msgr2=0x7fab8c14f920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 shutdown_connections 2020-11-20T11:29:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.711+0000 7fab93a7e700 1 -- 172.21.15.67:0/4161824695 wait complete. 2020-11-20T11:29:10.725 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 94f71992-cb21-4ce6-85b6-a8f9d04cbfef 8 2020-11-20T11:29:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.851+0000 7f239058f700 1 Processor -- start 2020-11-20T11:29:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.851+0000 7f239058f700 1 -- start start 2020-11-20T11:29:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f239058f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2388150d30 0x7f2388151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f239058f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2388151710 0x7f238809ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f239058f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2388065060 con 0x7f23880626f0 2020-11-20T11:29:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f239058f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2388065300 con 0x7f2388150d30 2020-11-20T11:29:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f239058f700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880655a0 con 0x7f2388151710 2020-11-20T11:29:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2388150d30 0x7f2388151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238eb2c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f23880626f0 0x7f23880667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59060/0 (socket says 172.21.15.67:59060) 2020-11-20T11:29:10.863 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238eb2c700 1 -- 172.21.15.67:0/2769089976 learned_addr learned my addr 172.21.15.67:0/2769089976 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:10.863 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238db2a700 1 --2- 172.21.15.67:0/2769089976 >> v2:172.21.15.100:3300/0 conn(0x7f2388151710 0x7f238809ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.863 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 -- 172.21.15.67:0/2769089976 >> v2:172.21.15.100:3300/0 conn(0x7f2388151710 msgr2=0x7f238809ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:10.863 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 --2- 172.21.15.67:0/2769089976 >> v2:172.21.15.100:3300/0 conn(0x7f2388151710 0x7f238809ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.863 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 -- 172.21.15.67:0/2769089976 >> v1:172.21.15.67:6789/0 conn(0x7f23880626f0 legacy=0x7f23880667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 -- 172.21.15.67:0/2769089976 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388065840 con 0x7f2388150d30 2020-11-20T11:29:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.852+0000 7f238e32b700 1 --2- 172.21.15.67:0/2769089976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f2388151110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2388151600 tx=0x7f2384006df0).ready entity=mon.0 client_cookie=54a5f59164a3cdfc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f238d329700 1 -- 172.21.15.67:0/2769089976 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840096b0 con 0x7f2388150d30 2020-11-20T11:29:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f238d329700 1 -- 172.21.15.67:0/2769089976 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384009810 con 0x7f2388150d30 2020-11-20T11:29:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f238d329700 1 -- 172.21.15.67:0/2769089976 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384009b90 con 0x7f2388150d30 2020-11-20T11:29:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 -- 172.21.15.67:0/2769089976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 msgr2=0x7f2388151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 --2- 172.21.15.67:0/2769089976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f2388151110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2388151600 tx=0x7f2384006df0).stop 2020-11-20T11:29:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 -- 172.21.15.67:0/2769089976 shutdown_connections 2020-11-20T11:29:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 --2- 172.21.15.67:0/2769089976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f2388151110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 --2- 172.21.15.67:0/2769089976 >> v2:172.21.15.100:3300/0 conn(0x7f2388151710 0x7f238809ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 -- 172.21.15.67:0/2769089976 >> 172.21.15.67:0/2769089976 conn(0x7f23880b9890 msgr2=0x7f23880b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 -- 172.21.15.67:0/2769089976 shutdown_connections 2020-11-20T11:29:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.853+0000 7f239058f700 1 -- 172.21.15.67:0/2769089976 wait complete. 2020-11-20T11:29:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.854+0000 7f239058f700 1 Processor -- start 2020-11-20T11:29:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.854+0000 7f239058f700 1 -- start start 2020-11-20T11:29:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 0x7f238814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2388151710 0x7f238814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388163b60 con 0x7f2388150d30 2020-11-20T11:29:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388163e00 con 0x7f23880626f0 2020-11-20T11:29:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f239058f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23881640a0 con 0x7f2388151710 2020-11-20T11:29:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f238db2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f238db2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37272/0 (socket says 172.21.15.67:37272) 2020-11-20T11:29:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f238db2a700 1 -- 172.21.15.67:0/4131849413 learned_addr learned my addr 172.21.15.67:0/4131849413 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f238e32b700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 0x7f238814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.855+0000 7f238eb2c700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2388151710 0x7f238814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 -- 172.21.15.67:0/4131849413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2388151710 msgr2=0x7f238814c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2388151710 0x7f238814c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 -- 172.21.15.67:0/4131849413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 msgr2=0x7f238814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 0x7f238814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 -- 172.21.15.67:0/4131849413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388164340 con 0x7f2388150d30 2020-11-20T11:29:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238e32b700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 0x7f238814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f238db2a700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f237800eba0 tx=0x7f2378008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800c8b0 con 0x7f2388150d30 2020-11-20T11:29:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800ca10 con 0x7f2388150d30 2020-11-20T11:29:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23881645e0 con 0x7f2388150d30 2020-11-20T11:29:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800cd90 con 0x7f2388150d30 2020-11-20T11:29:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238814af20 con 0x7f2388150d30 2020-11-20T11:29:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f2378022070 con 0x7f2388150d30 2020-11-20T11:29:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.856+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f237801bb00 con 0x7f2388150d30 2020-11-20T11:29:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.857+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2388044f60 con 0x7f2388150d30 2020-11-20T11:29:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.859+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f237803a880 con 0x7f2388150d30 2020-11-20T11:29:10.958 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.955+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94f71992-cb21-4ce6-85b6-a8f9d04cbfef", "id": 8} v 0) v1 -- 0x7f23881513e0 con 0x7f2388150d30 2020-11-20T11:29:10.965 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.962+0000 7f23767fc700 1 -- 172.21.15.67:0/4131849413 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94f71992-cb21-4ce6-85b6-a8f9d04cbfef", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2378029030 con 0x7f2388150d30 2020-11-20T11:29:10.965 INFO:teuthology.orchestra.run.smithi067.stdout:8 2020-11-20T11:29:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 msgr2=0x7f238814c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f237800eba0 tx=0x7f2378008040).stop 2020-11-20T11:29:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 shutdown_connections 2020-11-20T11:29:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2388151710 0x7f238814c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23880626f0 0x7f238814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 --2- 172.21.15.67:0/4131849413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2388150d30 0x7f238814c340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 >> 172.21.15.67:0/4131849413 conn(0x7f23880b9890 msgr2=0x7f23881496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 shutdown_connections 2020-11-20T11:29:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:10.963+0000 7f239058f700 1 -- 172.21.15.67:0/4131849413 wait complete. 2020-11-20T11:29:10.977 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new a0e37a56-69a2-40a9-b41b-45b4a78c33db 9 2020-11-20T11:29:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.100+0000 7fc50c5f6700 1 Processor -- start 2020-11-20T11:29:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.100+0000 7fc50c5f6700 1 -- start start 2020-11-20T11:29:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50c5f6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5041548e0 0x7fc5040c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50c5f6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5040679b0 0x7fc5041514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50c5f6700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc504067e20 con 0x7fc504067540 2020-11-20T11:29:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50c5f6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5040c0cf0 con 0x7fc5041548e0 2020-11-20T11:29:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50c5f6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5040668c0 con 0x7fc5040679b0 2020-11-20T11:29:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50a392700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5041548e0 0x7fc5040c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc509b91700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc504067540 0x7fc504154cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.67:37064/0 (socket says 172.21.15.67:37064) 2020-11-20T11:29:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc509b91700 1 -- 172.21.15.67:0/2047100100 learned_addr learned my addr 172.21.15.67:0/2047100100 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.101+0000 7fc50ab93700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5040679b0 0x7fc5041514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc50a392700 1 -- 172.21.15.67:0/2047100100 >> v2:172.21.15.105:3300/0 conn(0x7fc5040679b0 msgr2=0x7fc5041514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc50a392700 1 --2- 172.21.15.67:0/2047100100 >> v2:172.21.15.105:3300/0 conn(0x7fc5040679b0 0x7fc5041514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc50a392700 1 -- 172.21.15.67:0/2047100100 >> v1:172.21.15.100:6789/0 conn(0x7fc504067540 legacy=0x7fc504154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc50a392700 1 -- 172.21.15.67:0/2047100100 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504066b60 con 0x7fc5041548e0 2020-11-20T11:29:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc509390700 1 -- 172.21.15.67:0/2047100100 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085543205 0 0) 0x7fc4f40010d0 con 0x7fc504067540 2020-11-20T11:29:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc50a392700 1 --2- 172.21.15.67:0/2047100100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc5040c1360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc50409cb90 tx=0x7fc4fc006df0).ready entity=mon.1 client_cookie=85ddabba20f6269f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc509390700 1 -- 172.21.15.67:0/2047100100 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009840 con 0x7fc5041548e0 2020-11-20T11:29:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc509390700 1 -- 172.21.15.67:0/2047100100 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0099a0 con 0x7fc5041548e0 2020-11-20T11:29:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.102+0000 7fc509390700 1 -- 172.21.15.67:0/2047100100 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009d20 con 0x7fc5041548e0 2020-11-20T11:29:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 -- 172.21.15.67:0/2047100100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 msgr2=0x7fc5040c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/2047100100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc5040c1360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc50409cb90 tx=0x7fc4fc006df0).stop 2020-11-20T11:29:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 -- 172.21.15.67:0/2047100100 shutdown_connections 2020-11-20T11:29:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/2047100100 >> v2:172.21.15.105:3300/0 conn(0x7fc5040679b0 0x7fc5041514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/2047100100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc5040c1360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 -- 172.21.15.67:0/2047100100 >> 172.21.15.67:0/2047100100 conn(0x7fc504026530 msgr2=0x7fc5040c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.112 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 -- 172.21.15.67:0/2047100100 shutdown_connections 2020-11-20T11:29:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.103+0000 7fc50c5f6700 1 -- 172.21.15.67:0/2047100100 wait complete. 2020-11-20T11:29:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 Processor -- start 2020-11-20T11:29:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 -- start start 2020-11-20T11:29:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5040679b0 0x7fc50414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc504093350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504064020 con 0x7fc504067540 2020-11-20T11:29:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040642c0 con 0x7fc5041548e0 2020-11-20T11:29:11.117 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.104+0000 7fc50c5f6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504064560 con 0x7fc5040679b0 2020-11-20T11:29:11.117 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.117 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37282/0 (socket says 172.21.15.67:37282) 2020-11-20T11:29:11.117 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 -- 172.21.15.67:0/4277071873 learned_addr learned my addr 172.21.15.67:0/4277071873 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc509b91700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5040679b0 0x7fc50414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50ab93700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc504093350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 -- 172.21.15.67:0/4277071873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5040679b0 msgr2=0x7fc50414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5040679b0 0x7fc50414dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 -- 172.21.15.67:0/4277071873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 msgr2=0x7fc504093350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.119 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc504093350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.119 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 -- 172.21.15.67:0/4277071873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504064800 con 0x7fc504067540 2020-11-20T11:29:11.119 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50ab93700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc504093350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:11.119 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50a392700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc504066220 tx=0x7fc4fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.119 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc011dd0 con 0x7fc504067540 2020-11-20T11:29:11.120 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc01e460 con 0x7fc504067540 2020-11-20T11:29:11.120 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc01e7e0 con 0x7fc504067540 2020-11-20T11:29:11.120 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc504064aa0 con 0x7fc504067540 2020-11-20T11:29:11.120 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.105+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50414e490 con 0x7fc504067540 2020-11-20T11:29:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.106+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504044f60 con 0x7fc504067540 2020-11-20T11:29:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.106+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fc4fc025030 con 0x7fc504067540 2020-11-20T11:29:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.106+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7fc4fc028ca0 con 0x7fc504067540 2020-11-20T11:29:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.108+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fc4fc02d060 con 0x7fc504067540 2020-11-20T11:29:11.193 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.191+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7fc4fc01a040 con 0x7fc504067540 2020-11-20T11:29:11.214 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.212+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0e37a56-69a2-40a9-b41b-45b4a78c33db", "id": 9} v 0) v1 -- 0x7fc50409d180 con 0x7fc504067540 2020-11-20T11:29:11.239 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.236+0000 7fc4f27fc700 1 -- 172.21.15.67:0/4277071873 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0e37a56-69a2-40a9-b41b-45b4a78c33db", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc4fc023030 con 0x7fc504067540 2020-11-20T11:29:11.239 INFO:teuthology.orchestra.run.smithi067.stdout:9 2020-11-20T11:29:11.240 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 msgr2=0x7fc504161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.241 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc504066220 tx=0x7fc4fc015000).stop 2020-11-20T11:29:11.241 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 shutdown_connections 2020-11-20T11:29:11.241 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5041548e0 0x7fc504093350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.241 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc504067540 0x7fc504161290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.242 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 --2- 172.21.15.67:0/4277071873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5040679b0 0x7fc50414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.242 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 >> 172.21.15.67:0/4277071873 conn(0x7fc504026530 msgr2=0x7fc5040bffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.242 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.237+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 shutdown_connections 2020-11-20T11:29:11.242 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.238+0000 7fc50c5f6700 1 -- 172.21.15.67:0/4277071873 wait complete. 2020-11-20T11:29:11.244 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:11.246 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:11.249 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:11.252 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new fbedbd4f-e258-4b85-a402-39224f5f7eaa 10 2020-11-20T11:29:11.419 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.416+0000 7f3d7e2f0700 1 Processor -- start 2020-11-20T11:29:11.419 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.416+0000 7f3d7e2f0700 1 -- start start 2020-11-20T11:29:11.422 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7e2f0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d780c38a0 0x7f3d78152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.422 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7e2f0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d78062050 con 0x7f3d7814f310 2020-11-20T11:29:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7e2f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7814fe70 con 0x7f3d780c34c0 2020-11-20T11:29:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7e2f0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d781533b0 con 0x7f3d780c38a0 2020-11-20T11:29:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d777fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d780c38a0 0x7f3d78152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7c88d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3d7814f310 0x7f3d7814f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59084/0 (socket says 172.21.15.67:59084) 2020-11-20T11:29:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d7c88d700 1 -- 172.21.15.67:0/1346310012 learned_addr learned my addr 172.21.15.67:0/1346310012 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:11.424 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.417+0000 7f3d777fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d780c38a0 0x7f3d78152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37290/0 (socket says 172.21.15.67:37290) 2020-11-20T11:29:11.424 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d777fe700 1 -- 172.21.15.67:0/1346310012 >> v1:172.21.15.105:6789/0 conn(0x7f3d780c34c0 legacy=0x7f3d780bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.424 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d777fe700 1 -- 172.21.15.67:0/1346310012 >> v1:172.21.15.67:6789/0 conn(0x7f3d7814f310 legacy=0x7f3d7814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.424 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d76ffd700 1 -- 172.21.15.67:0/1346310012 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494435022 0 0) 0x7f3d78062050 con 0x7f3d7814f310 2020-11-20T11:29:11.424 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d777fe700 1 -- 172.21.15.67:0/1346310012 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78062280 con 0x7f3d780c38a0 2020-11-20T11:29:11.425 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d777fe700 1 --2- 172.21.15.67:0/1346310012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d78152ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3d6000b9c0 tx=0x7f3d60006d90).ready entity=mon.0 client_cookie=2466217f48aa5458 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.425 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d76ffd700 1 -- 172.21.15.67:0/1346310012 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60006030 con 0x7f3d780c38a0 2020-11-20T11:29:11.425 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d76ffd700 1 -- 172.21.15.67:0/1346310012 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60006190 con 0x7f3d780c38a0 2020-11-20T11:29:11.425 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d76ffd700 1 -- 172.21.15.67:0/1346310012 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60006510 con 0x7f3d780c38a0 2020-11-20T11:29:11.425 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/1346310012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 msgr2=0x7f3d78152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/1346310012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d78152ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3d6000b9c0 tx=0x7f3d60006d90).stop 2020-11-20T11:29:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/1346310012 shutdown_connections 2020-11-20T11:29:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/1346310012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d78152ec0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.418+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/1346310012 >> 172.21.15.67:0/1346310012 conn(0x7f3d780b9890 msgr2=0x7f3d780b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.419+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/1346310012 shutdown_connections 2020-11-20T11:29:11.427 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.419+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/1346310012 wait complete. 2020-11-20T11:29:11.427 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.420+0000 7f3d7e2f0700 1 Processor -- start 2020-11-20T11:29:11.427 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.420+0000 7f3d7e2f0700 1 -- start start 2020-11-20T11:29:11.430 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.420+0000 7f3d7e2f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d780c34c0 0x7f3d7815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.430 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.430 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7814f310 0x7f3d7808f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.430 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7815f050 con 0x7f3d780c38a0 2020-11-20T11:29:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78091340 con 0x7f3d7814f310 2020-11-20T11:29:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780915e0 con 0x7f3d780c34c0 2020-11-20T11:29:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37296/0 (socket says 172.21.15.67:37296) 2020-11-20T11:29:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 -- 172.21.15.67:0/3990082857 learned_addr learned my addr 172.21.15.67:0/3990082857 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:11.432 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d77fff700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d780c34c0 0x7f3d7815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.432 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7c88d700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7814f310 0x7f3d7808f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.432 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 -- 172.21.15.67:0/3990082857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d780c34c0 msgr2=0x7f3d7815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.432 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d780c34c0 0x7f3d7815f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.432 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 -- 172.21.15.67:0/3990082857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7814f310 msgr2=0x7f3d7808f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.433 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7814f310 0x7f3d7808f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.433 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 -- 172.21.15.67:0/3990082857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7808ebe0 con 0x7f3d780c38a0 2020-11-20T11:29:11.433 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d777fe700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3d6000c010 tx=0x7f3d60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.433 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60021070 con 0x7f3d780c38a0 2020-11-20T11:29:11.433 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60005ab0 con 0x7f3d780c38a0 2020-11-20T11:29:11.434 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7808ee80 con 0x7f3d780c38a0 2020-11-20T11:29:11.434 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60005e30 con 0x7f3d780c38a0 2020-11-20T11:29:11.434 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.421+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d78090f20 con 0x7f3d780c38a0 2020-11-20T11:29:11.434 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.422+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f3d6000f070 con 0x7f3d780c38a0 2020-11-20T11:29:11.434 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.422+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2280+0+0 (secure 0 0 0) 0x7f3d6003e770 con 0x7f3d780c38a0 2020-11-20T11:29:11.435 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.423+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d78091110 con 0x7f3d780c38a0 2020-11-20T11:29:11.435 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.425+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f3d60018960 con 0x7f3d780c38a0 2020-11-20T11:29:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.531+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbedbd4f-e258-4b85-a402-39224f5f7eaa", "id": 10} v 0) v1 -- 0x7f3d7808f2e0 con 0x7f3d780c38a0 2020-11-20T11:29:11.537 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.534+0000 7f3d6ffff700 1 -- 172.21.15.67:0/3990082857 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbedbd4f-e258-4b85-a402-39224f5f7eaa", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7f3d60018370 con 0x7f3d780c38a0 2020-11-20T11:29:11.537 INFO:teuthology.orchestra.run.smithi067.stdout:10 2020-11-20T11:29:11.538 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 msgr2=0x7f3d7815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.538 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3d6000c010 tx=0x7f3d60015000).stop 2020-11-20T11:29:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 shutdown_connections 2020-11-20T11:29:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7814f310 0x7f3d7808f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d780c34c0 0x7f3d7815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 --2- 172.21.15.67:0/3990082857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d780c38a0 0x7f3d7815eb60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 >> 172.21.15.67:0/3990082857 conn(0x7f3d780b9890 msgr2=0x7f3d780c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 shutdown_connections 2020-11-20T11:29:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.535+0000 7f3d7e2f0700 1 -- 172.21.15.67:0/3990082857 wait complete. 2020-11-20T11:29:11.549 INFO:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 1a3c1bdf-8b24-456f-ae61-0c982d2c21dc 11 2020-11-20T11:29:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.673+0000 7f593f6d2700 1 Processor -- start 2020-11-20T11:29:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.673+0000 7f593f6d2700 1 -- start start 2020-11-20T11:29:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593f6d2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59380c78d0 0x7f59380c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593f6d2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5938155650 con 0x7f593814e260 2020-11-20T11:29:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593f6d2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59381512d0 con 0x7f5938066ec0 2020-11-20T11:29:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593f6d2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5938151570 con 0x7f59380c78d0 2020-11-20T11:29:11.680 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593cc6d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f593814e260 0x7f59380667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59096/0 (socket says 172.21.15.67:59096) 2020-11-20T11:29:11.680 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593cc6d700 1 -- 172.21.15.67:0/744608568 learned_addr learned my addr 172.21.15.67:0/744608568 (peer_addr_for_me v1:172.21.15.67:0/0) 2020-11-20T11:29:11.680 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.674+0000 7f593d46e700 1 --2- 172.21.15.67:0/744608568 >> v2:172.21.15.100:3300/0 conn(0x7f59380c78d0 0x7f59380c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f5927fff700 1 -- 172.21.15.67:0/744608568 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163128962 0 0) 0x7f59381512d0 con 0x7f5938066ec0 2020-11-20T11:29:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f5927fff700 1 -- 172.21.15.67:0/744608568 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5920003240 con 0x7f5938066ec0 2020-11-20T11:29:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593d46e700 1 -- 172.21.15.67:0/744608568 >> v1:172.21.15.100:6789/0 conn(0x7f5938066ec0 legacy=0x7f5938154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593d46e700 1 -- 172.21.15.67:0/744608568 >> v1:172.21.15.67:6789/0 conn(0x7f593814e260 legacy=0x7f59380667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593d46e700 1 -- 172.21.15.67:0/744608568 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938151810 con 0x7f59380c78d0 2020-11-20T11:29:11.682 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593d46e700 1 --2- 172.21.15.67:0/744608568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380c78d0 0x7f59380c7cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5930009c90 tx=0x7f59300091d0).ready entity=mon.1 client_cookie=3d986e30ce73afa5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.682 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f5927fff700 1 -- 172.21.15.67:0/744608568 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000bb00 con 0x7f59380c78d0 2020-11-20T11:29:11.682 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f5927fff700 1 -- 172.21.15.67:0/744608568 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593000bc60 con 0x7f59380c78d0 2020-11-20T11:29:11.682 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f5927fff700 1 -- 172.21.15.67:0/744608568 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930011400 con 0x7f59380c78d0 2020-11-20T11:29:11.683 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593f6d2700 1 -- 172.21.15.67:0/744608568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380c78d0 msgr2=0x7f59380c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.683 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593f6d2700 1 --2- 172.21.15.67:0/744608568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380c78d0 0x7f59380c7cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5930009c90 tx=0x7f59300091d0).stop 2020-11-20T11:29:11.683 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593f6d2700 1 -- 172.21.15.67:0/744608568 shutdown_connections 2020-11-20T11:29:11.683 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593f6d2700 1 --2- 172.21.15.67:0/744608568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380c78d0 0x7f59380c7cb0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0x7f5930009c90 tx=0x7f59300091d0).stop 2020-11-20T11:29:11.684 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.675+0000 7f593f6d2700 1 -- 172.21.15.67:0/744608568 >> 172.21.15.67:0/744608568 conn(0x7f59380bdca0 msgr2=0x7f59380be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.684 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.676+0000 7f593f6d2700 1 -- 172.21.15.67:0/744608568 shutdown_connections 2020-11-20T11:29:11.684 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.676+0000 7f593f6d2700 1 -- 172.21.15.67:0/744608568 wait complete. 2020-11-20T11:29:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.677+0000 7f593f6d2700 1 Processor -- start 2020-11-20T11:29:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.677+0000 7f593f6d2700 1 -- start start 2020-11-20T11:29:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 0x7f5938152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.688 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 0x7f59381506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.688 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5938150bb0 0x7f5938154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:11.688 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938153ca0 con 0x7f593814e260 2020-11-20T11:29:11.688 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938152b10 con 0x7f5938066ec0 2020-11-20T11:29:11.688 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593f6d2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593814d000 con 0x7f5938150bb0 2020-11-20T11:29:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593cc6d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 0x7f59381506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593cc6d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 0x7f59381506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37308/0 (socket says 172.21.15.67:37308) 2020-11-20T11:29:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593cc6d700 1 -- 172.21.15.67:0/3456579893 learned_addr learned my addr 172.21.15.67:0/3456579893 (peer_addr_for_me v2:172.21.15.67:0/0) 2020-11-20T11:29:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 0x7f5938152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.690 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593dc6f700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5938150bb0 0x7f5938154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:11.690 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 -- 172.21.15.67:0/3456579893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5938150bb0 msgr2=0x7f5938154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.690 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5938150bb0 0x7f5938154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.690 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 -- 172.21.15.67:0/3456579893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 msgr2=0x7f59381506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 0x7f59381506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 -- 172.21.15.67:0/3456579893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593814d2a0 con 0x7f5938066ec0 2020-11-20T11:29:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.678+0000 7f593d46e700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 0x7f5938152530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5930013000 tx=0x7f5930016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593001d480 con 0x7f5938066ec0 2020-11-20T11:29:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593001d5e0 con 0x7f5938066ec0 2020-11-20T11:29:11.692 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593814d540 con 0x7f5938066ec0 2020-11-20T11:29:11.692 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593001d9a0 con 0x7f5938066ec0 2020-11-20T11:29:11.692 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593814da80 con 0x7f5938066ec0 2020-11-20T11:29:11.692 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f5930024030 con 0x7f5938066ec0 2020-11-20T11:29:11.692 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.679+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2419+0+0 (secure 0 0 0) 0x7f593003e990 con 0x7f5938066ec0 2020-11-20T11:29:11.693 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.680+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5938152e70 con 0x7f5938066ec0 2020-11-20T11:29:11.693 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.682+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f5930022020 con 0x7f5938066ec0 2020-11-20T11:29:11.779 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.776+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a3c1bdf-8b24-456f-ae61-0c982d2c21dc", "id": 11} v 0) v1 -- 0x7f5938044f60 con 0x7f5938066ec0 2020-11-20T11:29:11.784 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.782+0000 7f59257fa700 1 -- 172.21.15.67:0/3456579893 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a3c1bdf-8b24-456f-ae61-0c982d2c21dc", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f593001c3e0 con 0x7f5938066ec0 2020-11-20T11:29:11.784 INFO:teuthology.orchestra.run.smithi067.stdout:11 2020-11-20T11:29:11.785 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.782+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 msgr2=0x7f5938152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:11.786 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 0x7f5938152530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5930013000 tx=0x7f5930016000).stop 2020-11-20T11:29:11.786 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 shutdown_connections 2020-11-20T11:29:11.786 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5938150bb0 0x7f5938154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.786 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5938066ec0 0x7f5938152530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.787 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 --2- 172.21.15.67:0/3456579893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593814e260 0x7f59381506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:11.787 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 >> 172.21.15.67:0/3456579893 conn(0x7f59380bdca0 msgr2=0x7f59380c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:11.787 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 shutdown_connections 2020-11-20T11:29:11.787 INFO:teuthology.orchestra.run.smithi067.stderr:2020-11-20T11:29:11.783+0000 7f593f6d2700 1 -- 172.21.15.67:0/3456579893 wait complete. 2020-11-20T11:29:11.796 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T11:29:11.797 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T11:29:11.799 INFO:tasks.ceph.osd.0:Started 2020-11-20T11:29:11.800 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T11:29:11.800 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T11:29:11.802 INFO:tasks.ceph.osd.3:Started 2020-11-20T11:29:11.802 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T11:29:11.803 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T11:29:11.805 INFO:tasks.ceph.osd.6:Started 2020-11-20T11:29:11.805 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T11:29:11.806 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T11:29:11.808 INFO:tasks.ceph.osd.9:Started 2020-11-20T11:29:11.808 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T11:29:11.808 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T11:29:11.811 INFO:tasks.ceph.osd.1:Started 2020-11-20T11:29:11.811 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T11:29:11.812 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T11:29:11.814 INFO:tasks.ceph.osd.4:Started 2020-11-20T11:29:11.814 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T11:29:11.815 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T11:29:11.817 INFO:tasks.ceph.osd.7:Started 2020-11-20T11:29:11.817 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T11:29:11.818 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T11:29:11.820 INFO:tasks.ceph.osd.10:Started 2020-11-20T11:29:11.820 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T11:29:11.820 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T11:29:11.822 INFO:tasks.ceph.osd.2:Started 2020-11-20T11:29:11.823 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T11:29:11.823 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T11:29:11.825 INFO:tasks.ceph.osd.5:Started 2020-11-20T11:29:11.826 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T11:29:11.826 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T11:29:11.828 INFO:tasks.ceph.osd.8:Started 2020-11-20T11:29:11.828 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T11:29:11.829 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T11:29:11.831 INFO:tasks.ceph.osd.11:Started 2020-11-20T11:29:11.831 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T11:29:12.399 INFO:tasks.ceph.osd.0.smithi105.stderr:2020-11-20T11:29:12.396+0000 7fcd38554ec0 -1 Falling back to public interface 2020-11-20T11:29:12.591 INFO:tasks.ceph.osd.11.smithi067.stderr:2020-11-20T11:29:12.427+0000 7ff830f4fec0 -1 Falling back to public interface 2020-11-20T11:29:12.592 INFO:tasks.ceph.osd.5.smithi067.stderr:2020-11-20T11:29:12.439+0000 7f5db383eec0 -1 Falling back to public interface 2020-11-20T11:29:12.592 INFO:tasks.ceph.osd.8.smithi067.stderr:2020-11-20T11:29:12.446+0000 7f69c8869ec0 -1 Falling back to public interface 2020-11-20T11:29:12.592 INFO:tasks.ceph.osd.2.smithi067.stderr:2020-11-20T11:29:12.452+0000 7f3c40f15ec0 -1 Falling back to public interface 2020-11-20T11:29:12.593 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:29:12.410+0000 7f9a0c966ec0 -1 Falling back to public interface 2020-11-20T11:29:12.593 INFO:tasks.ceph.osd.4.smithi100.stderr:2020-11-20T11:29:12.419+0000 7f2653316ec0 -1 Falling back to public interface 2020-11-20T11:29:12.593 INFO:tasks.ceph.osd.7.smithi100.stderr:2020-11-20T11:29:12.419+0000 7fef3315cec0 -1 Falling back to public interface 2020-11-20T11:29:12.593 INFO:tasks.ceph.osd.10.smithi100.stderr:2020-11-20T11:29:12.429+0000 7fa4890b3ec0 -1 Falling back to public interface 2020-11-20T11:29:12.594 INFO:tasks.ceph.osd.3.smithi105.stderr:2020-11-20T11:29:12.398+0000 7fe10a818ec0 -1 Falling back to public interface 2020-11-20T11:29:12.594 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-11-20T11:29:12.400+0000 7f2846918ec0 -1 Falling back to public interface 2020-11-20T11:29:12.594 INFO:tasks.ceph.osd.9.smithi105.stderr:2020-11-20T11:29:12.408+0000 7efc37247ec0 -1 Falling back to public interface 2020-11-20T11:29:13.197 INFO:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:13.305 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.303+0000 7f1d1d97f700 1 Processor -- start 2020-11-20T11:29:13.306 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.303+0000 7f1d1d97f700 1 -- start start 2020-11-20T11:29:13.307 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d1d97f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d18150c80 0x7f1d18151060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:13.307 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d1d97f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d180baf80 con 0x7f1d18066ab0 2020-11-20T11:29:13.307 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d1d97f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d18065300 con 0x7f1d180be7c0 2020-11-20T11:29:13.307 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d1d97f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180655a0 con 0x7f1d18150c80 2020-11-20T11:29:13.307 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d167fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1d180be7c0 0x7f1d180ba870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:59534/0 (socket says 172.21.15.105:59534) 2020-11-20T11:29:13.308 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d167fc700 1 -- 172.21.15.105:0/3728538338 learned_addr learned my addr 172.21.15.105:0/3728538338 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:13.308 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d16ffd700 1 --2- 172.21.15.105:0/3728538338 >> v2:172.21.15.67:3300/0 conn(0x7f1d18150c80 0x7f1d18151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:13.308 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528298397 0 0) 0x7f1d18065300 con 0x7f1d180be7c0 2020-11-20T11:29:13.312 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf8003240 con 0x7f1d180be7c0 2020-11-20T11:29:13.312 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4225122934 0 0) 0x7f1cf8003240 con 0x7f1d180be7c0 2020-11-20T11:29:13.312 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d16ffd700 1 -- 172.21.15.105:0/3728538338 >> v1:172.21.15.100:6789/0 conn(0x7f1d180be7c0 legacy=0x7f1d180ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.312 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d16ffd700 1 -- 172.21.15.105:0/3728538338 >> v1:172.21.15.67:6789/0 conn(0x7f1d18066ab0 legacy=0x7f1d1814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.313 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d16ffd700 1 -- 172.21.15.105:0/3728538338 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18065840 con 0x7f1d18150c80 2020-11-20T11:29:13.313 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.304+0000 7f1d16ffd700 1 --2- 172.21.15.105:0/3728538338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18150c80 0x7f1d18151060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1d1000adb0 tx=0x7f1d1000a370).ready entity=mon.0 client_cookie=afc3a1226a03fcf4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:13.313 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080014e0 con 0x7f1d18150c80 2020-11-20T11:29:13.313 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000c9c0 con 0x7f1d18150c80 2020-11-20T11:29:13.313 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d15ffb700 1 -- 172.21.15.105:0/3728538338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000cd40 con 0x7f1d18150c80 2020-11-20T11:29:13.314 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 -- 172.21.15.105:0/3728538338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18150c80 msgr2=0x7f1d18151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.314 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/3728538338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18150c80 0x7f1d18151060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1d1000adb0 tx=0x7f1d1000a370).stop 2020-11-20T11:29:13.314 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 -- 172.21.15.105:0/3728538338 shutdown_connections 2020-11-20T11:29:13.314 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/3728538338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18150c80 0x7f1d18151060 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.314 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 -- 172.21.15.105:0/3728538338 >> 172.21.15.105:0/3728538338 conn(0x7f1d180c3e90 msgr2=0x7f1d180bfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:13.315 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 -- 172.21.15.105:0/3728538338 shutdown_connections 2020-11-20T11:29:13.315 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.305+0000 7f1d1d97f700 1 -- 172.21.15.105:0/3728538338 wait complete. 2020-11-20T11:29:13.315 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.306+0000 7f1d1d97f700 1 Processor -- start 2020-11-20T11:29:13.315 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.306+0000 7f1d1d97f700 1 -- start start 2020-11-20T11:29:13.315 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18066ab0 0x7f1d181610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:13.316 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180be7c0 0x7f1d1814d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:13.316 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:13.316 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d181615a0 con 0x7f1d18066ab0 2020-11-20T11:29:13.316 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1814d8b0 con 0x7f1d180be7c0 2020-11-20T11:29:13.316 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d1d97f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1814f250 con 0x7f1d18150c80 2020-11-20T11:29:13.317 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:13.317 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40918/0 (socket says 172.21.15.105:40918) 2020-11-20T11:29:13.317 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 -- 172.21.15.105:0/239097719 learned_addr learned my addr 172.21.15.105:0/239097719 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:13.317 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d167fc700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180be7c0 0x7f1d1814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:13.317 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d16ffd700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18066ab0 0x7f1d181610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:13.318 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 -- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180be7c0 msgr2=0x7f1d1814d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.318 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180be7c0 0x7f1d1814d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.318 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 -- 172.21.15.105:0/239097719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18066ab0 msgr2=0x7f1d181610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.318 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18066ab0 0x7f1d181610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.318 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.307+0000 7f1d177fe700 1 -- 172.21.15.105:0/239097719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1814f4f0 con 0x7f1d18150c80 2020-11-20T11:29:13.319 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d177fe700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d0000c7e0 tx=0x7f1d00007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:13.319 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000a580 con 0x7f1d18150c80 2020-11-20T11:29:13.319 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0000a6e0 con 0x7f1d18150c80 2020-11-20T11:29:13.319 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1814f790 con 0x7f1d18150c80 2020-11-20T11:29:13.319 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000aa80 con 0x7f1d18150c80 2020-11-20T11:29:13.320 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.308+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1814fcd0 con 0x7f1d18150c80 2020-11-20T11:29:13.320 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.309+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1814fe90 con 0x7f1d18150c80 2020-11-20T11:29:13.320 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.309+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 3) v1 ==== 101030+0+0 (secure 0 0 0) 0x7f1d00010070 con 0x7f1d18150c80 2020-11-20T11:29:13.320 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.310+0000 7f1d0effd700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 0x7f1cf4082a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:13.321 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.310+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2534+0+0 (secure 0 0 0) 0x7f1d000a0e40 con 0x7f1d18150c80 2020-11-20T11:29:13.321 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.310+0000 7f1d16ffd700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 0x7f1cf4082a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:13.322 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.310+0000 7f1d16ffd700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 0x7f1cf4082a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1d1000d010 tx=0x7f1d180639e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:13.322 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.313+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1d00077020 con 0x7f1d18150c80 2020-11-20T11:29:13.484 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.481+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d18044f60 con 0x7f1d18150c80 2020-11-20T11:29:13.484 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.482+0000 7f1d0effd700 1 -- 172.21.15.105:0/239097719 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11483 (secure 0 0 0) 0x7f1d0007a640 con 0x7f1d18150c80 2020-11-20T11:29:13.485 INFO:teuthology.misc.health.smithi105.stdout: 2020-11-20T11:29:13.485 INFO:teuthology.misc.health.smithi105.stdout:{"epoch":14,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:11.777990+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:13.486 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 msgr2=0x7f1cf4082a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.487 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 0x7f1cf4082a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1d1000d010 tx=0x7f1d180639e0).stop 2020-11-20T11:29:13.487 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 msgr2=0x7f1d180c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:13.487 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d0000c7e0 tx=0x7f1d00007b90).stop 2020-11-20T11:29:13.487 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 shutdown_connections 2020-11-20T11:29:13.488 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1cf4080550 0x7f1cf4082a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.488 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d18150c80 0x7f1d180c1980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.488 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d18066ab0 0x7f1d181610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.488 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 --2- 172.21.15.105:0/239097719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180be7c0 0x7f1d1814d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:13.488 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 >> 172.21.15.105:0/239097719 conn(0x7f1d180c3e90 msgr2=0x7f1d180c2650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:13.489 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 shutdown_connections 2020-11-20T11:29:13.489 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:13.484+0000 7f1d1d97f700 1 -- 172.21.15.105:0/239097719 wait complete. 2020-11-20T11:29:13.496 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T11:29:13.725 INFO:tasks.ceph.osd.3.smithi105.stderr:2020-11-20T11:29:13.722+0000 7fe10a818ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T11:29:13.729 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-11-20T11:29:13.727+0000 7f2846918ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T11:29:13.732 INFO:tasks.ceph.osd.0.smithi105.stderr:2020-11-20T11:29:13.730+0000 7fcd38554ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T11:29:13.735 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:29:13.732+0000 7f9a0c966ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T11:29:13.742 INFO:tasks.ceph.osd.9.smithi105.stderr:2020-11-20T11:29:13.740+0000 7efc37247ec0 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T11:29:13.750 INFO:tasks.ceph.osd.11.smithi067.stderr:2020-11-20T11:29:13.748+0000 7ff830f4fec0 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T11:29:13.759 INFO:tasks.ceph.osd.7.smithi100.stderr:2020-11-20T11:29:13.757+0000 7fef3315cec0 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T11:29:13.760 INFO:tasks.ceph.osd.4.smithi100.stderr:2020-11-20T11:29:13.757+0000 7f2653316ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T11:29:13.763 INFO:tasks.ceph.osd.10.smithi100.stderr:2020-11-20T11:29:13.761+0000 7fa4890b3ec0 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T11:29:13.777 INFO:tasks.ceph.osd.5.smithi067.stderr:2020-11-20T11:29:13.775+0000 7f5db383eec0 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T11:29:13.792 INFO:tasks.ceph.osd.8.smithi067.stderr:2020-11-20T11:29:13.790+0000 7f69c8869ec0 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T11:29:13.799 INFO:tasks.ceph.osd.2.smithi067.stderr:2020-11-20T11:29:13.797+0000 7f3c40f15ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T11:29:15.216 INFO:tasks.ceph.osd.10.smithi100.stderr:2020-11-20T11:29:15.213+0000 7fa47f8c9700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T11:29:15.216 INFO:tasks.ceph.osd.11.smithi067.stderr:2020-11-20T11:29:15.213+0000 7ff827765700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T11:29:15.217 INFO:tasks.ceph.osd.2.smithi067.stderr:2020-11-20T11:29:15.214+0000 7f3c38f2e700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T11:29:15.218 INFO:tasks.ceph.osd.8.smithi067.stderr:2020-11-20T11:29:15.214+0000 7f69bf07f700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T11:29:15.219 INFO:tasks.ceph.osd.4.smithi100.stderr:2020-11-20T11:29:15.215+0000 7f2649b2c700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T11:29:15.221 INFO:tasks.ceph.osd.9.smithi105.stderr:2020-11-20T11:29:15.216+0000 7efc2f260700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T11:29:15.221 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-11-20T11:29:15.216+0000 7f283e931700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T11:29:15.221 INFO:tasks.ceph.osd.0.smithi105.stderr:2020-11-20T11:29:15.216+0000 7fcd2ed6a700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T11:29:15.222 INFO:tasks.ceph.osd.3.smithi105.stderr:2020-11-20T11:29:15.216+0000 7fe102831700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T11:29:15.222 INFO:tasks.ceph.osd.5.smithi067.stderr:2020-11-20T11:29:15.216+0000 7f5daa054700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T11:29:15.222 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:29:15.216+0000 7f9a0317c700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T11:29:15.223 INFO:tasks.ceph.osd.7.smithi100.stderr:2020-11-20T11:29:15.220+0000 7fef29972700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T11:29:20.706 INFO:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:23.681 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.677+0000 7f2edcd5a700 1 Processor -- start 2020-11-20T11:29:23.681 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.677+0000 7f2edcd5a700 1 -- start start 2020-11-20T11:29:23.683 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2edcd5a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ed80bec80 0x7f2ed8066b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.684 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2edcd5a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80c40f0 con 0x7f2ed8061ee0 2020-11-20T11:29:23.684 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2edcd5a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80bf0e0 con 0x7f2ed8067000 2020-11-20T11:29:23.684 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2edcd5a700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed8066910 con 0x7f2ed80bec80 2020-11-20T11:29:23.684 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2ed6d9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2ed8067000 0x7f2ed8151010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40828/0 (socket says 172.21.15.105:40828) 2020-11-20T11:29:23.684 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.678+0000 7f2ed6d9d700 1 -- 172.21.15.105:0/3716846560 learned_addr learned my addr 172.21.15.105:0/3716846560 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:23.685 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed5d9b700 1 --2- 172.21.15.105:0/3716846560 >> v2:172.21.15.100:3300/0 conn(0x7f2ed80bec80 0x7f2ed8066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.685 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052084477 0 0) 0x7f2ed80bf0e0 con 0x7f2ed8067000 2020-11-20T11:29:23.685 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc003240 con 0x7f2ed8067000 2020-11-20T11:29:23.685 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019865757 0 0) 0x7f2ed80c40f0 con 0x7f2ed8061ee0 2020-11-20T11:29:23.685 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed80bf0e0 con 0x7f2ed8061ee0 2020-11-20T11:29:23.686 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/3716846560 >> v1:172.21.15.105:6789/0 conn(0x7f2ed8067000 legacy=0x7f2ed8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.686 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/3716846560 >> v1:172.21.15.67:6789/0 conn(0x7f2ed8061ee0 legacy=0x7f2ed80622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.686 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/3716846560 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80c3e50 con 0x7f2ed80bec80 2020-11-20T11:29:23.686 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed5d9b700 1 --2- 172.21.15.105:0/3716846560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed80bec80 0x7f2ed8066b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2ec800b9a0 tx=0x7f2ec8006df0).ready entity=mon.1 client_cookie=49105eed7f504ab2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:23.686 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8009710 con 0x7f2ed80bec80 2020-11-20T11:29:23.687 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8009870 con 0x7f2ed80bec80 2020-11-20T11:29:23.687 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.679+0000 7f2ed559a700 1 -- 172.21.15.105:0/3716846560 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8009bf0 con 0x7f2ed80bec80 2020-11-20T11:29:23.688 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 -- 172.21.15.105:0/3716846560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed80bec80 msgr2=0x7f2ed8066b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.688 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/3716846560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed80bec80 0x7f2ed8066b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2ec800b9a0 tx=0x7f2ec8006df0).stop 2020-11-20T11:29:23.688 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 -- 172.21.15.105:0/3716846560 shutdown_connections 2020-11-20T11:29:23.688 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/3716846560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed80bec80 0x7f2ed8066b10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.688 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 -- 172.21.15.105:0/3716846560 >> 172.21.15.105:0/3716846560 conn(0x7f2ed8026500 msgr2=0x7f2ed80c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:23.689 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 -- 172.21.15.105:0/3716846560 shutdown_connections 2020-11-20T11:29:23.689 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.680+0000 7f2edcd5a700 1 -- 172.21.15.105:0/3716846560 wait complete. 2020-11-20T11:29:23.692 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.681+0000 7f2edcd5a700 1 Processor -- start 2020-11-20T11:29:23.692 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.681+0000 7f2edcd5a700 1 -- start start 2020-11-20T11:29:23.693 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed8061ee0 0x7f2ed81654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.693 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.693 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed80bec80 0x7f2ed80808b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.693 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a0000 con 0x7f2ed80bec80 2020-11-20T11:29:23.693 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81659b0 con 0x7f2ed8061ee0 2020-11-20T11:29:23.694 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8157c10 con 0x7f2ed8067000 2020-11-20T11:29:23.694 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.694 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41228/0 (socket says 172.21.15.105:41228) 2020-11-20T11:29:23.694 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/2687543430 learned_addr learned my addr 172.21.15.105:0/2687543430 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:23.694 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed6d9d700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed80bec80 0x7f2ed80808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.695 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed659c700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed8061ee0 0x7f2ed81654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.695 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed8061ee0 msgr2=0x7f2ed81654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.695 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed8061ee0 0x7f2ed81654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.695 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/2687543430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed80bec80 msgr2=0x7f2ed80808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.695 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed80bec80 0x7f2ed80808b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.696 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 -- 172.21.15.105:0/2687543430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8157eb0 con 0x7f2ed8067000 2020-11-20T11:29:23.696 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ed5d9b700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2ec8006fd0 tx=0x7f2ec8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:23.696 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011d40 con 0x7f2ed8067000 2020-11-20T11:29:23.696 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec801e460 con 0x7f2ed8067000 2020-11-20T11:29:23.696 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8158150 con 0x7f2ed8067000 2020-11-20T11:29:23.697 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011ea0 con 0x7f2ed8067000 2020-11-20T11:29:23.697 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.682+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8158690 con 0x7f2ed8067000 2020-11-20T11:29:23.697 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.683+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8044f60 con 0x7f2ed8067000 2020-11-20T11:29:23.697 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.684+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2ec8025030 con 0x7f2ed8067000 2020-11-20T11:29:23.698 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.684+0000 7f2ec67fc700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 0x7f2eac082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.698 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.685+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f2ec80a3aa0 con 0x7f2ed8067000 2020-11-20T11:29:23.698 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.685+0000 7f2ed659c700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 0x7f2eac082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.699 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.685+0000 7f2ed659c700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 0x7f2eac082b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2ecc000bc0 tx=0x7f2ecc007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:23.699 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.688+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2ec8078b30 con 0x7f2ed8067000 2020-11-20T11:29:23.857 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.853+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed8064200 con 0x7f2ed8067000 2020-11-20T11:29:23.858 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.854+0000 7f2ec67fc700 1 -- 172.21.15.105:0/2687543430 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16857 (secure 0 0 0) 0x7f2ec8023020 con 0x7f2ed8067000 2020-11-20T11:29:23.858 INFO:teuthology.misc.health.smithi105.stdout: 2020-11-20T11:29:23.858 INFO:teuthology.misc.health.smithi105.stdout:{"epoch":19,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:18.221069+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:23.859 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 msgr2=0x7f2eac082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.860 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 0x7f2eac082b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2ecc000bc0 tx=0x7f2ecc007a00).stop 2020-11-20T11:29:23.861 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 msgr2=0x7f2ed8062670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:23.861 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2ec8006fd0 tx=0x7f2ec8015000).stop 2020-11-20T11:29:23.861 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 shutdown_connections 2020-11-20T11:29:23.861 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed80bec80 0x7f2ed80808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.862 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ed8061ee0 0x7f2ed81654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.862 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2eac080660 0x7f2eac082b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.862 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 --2- 172.21.15.105:0/2687543430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8067000 0x7f2ed8062670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:23.862 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 >> 172.21.15.105:0/2687543430 conn(0x7f2ed8026500 msgr2=0x7f2ed814e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:23.863 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 shutdown_connections 2020-11-20T11:29:23.863 INFO:teuthology.misc.health.smithi105.stderr:2020-11-20T11:29:23.856+0000 7f2edcd5a700 1 -- 172.21.15.105:0/2687543430 wait complete. 2020-11-20T11:29:23.869 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T11:29:23.870 INFO:tasks.ceph:Creating RBD pool 2020-11-20T11:29:23.870 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T11:29:23.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.984+0000 7f81e7aa0700 1 Processor -- start 2020-11-20T11:29:23.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.984+0000 7f81e7aa0700 1 -- start start 2020-11-20T11:29:23.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e7aa0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81e00c3a10 0x7f81e014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:23.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e7aa0700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00bde30 con 0x7f81e009ad30 2020-11-20T11:29:23.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e7aa0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e014de60 con 0x7f81e014b410 2020-11-20T11:29:23.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e7aa0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00beae0 con 0x7f81e00c3a10 2020-11-20T11:29:23.998 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e583c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f81e014b410 0x7f81e0065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40838/0 (socket says 172.21.15.105:40838) 2020-11-20T11:29:23.998 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e583c700 1 -- 172.21.15.105:0/3589613796 learned_addr learned my addr 172.21.15.105:0/3589613796 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:23.998 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668580778 0 0) 0x7f81d00010d0 con 0x7f81e014b410 2020-11-20T11:29:23.998 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003240 con 0x7f81e014b410 2020-11-20T11:29:23.999 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e603d700 1 --2- 172.21.15.105:0/3589613796 >> v2:172.21.15.67:3300/0 conn(0x7f81e00c3a10 0x7f81e014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:23.999 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023227783 0 0) 0x7f81e00bde30 con 0x7f81e009ad30 2020-11-20T11:29:23.999 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d00010d0 con 0x7f81e009ad30 2020-11-20T11:29:23.999 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 467967210 0 0) 0x7f81c8003240 con 0x7f81e014b410 2020-11-20T11:29:23.999 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 >> v2:172.21.15.67:3300/0 conn(0x7f81e00c3a10 msgr2=0x7f81e014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:24.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 --2- 172.21.15.105:0/3589613796 >> v2:172.21.15.67:3300/0 conn(0x7f81e00c3a10 0x7f81e014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 >> v1:172.21.15.100:6789/0 conn(0x7f81e009ad30 legacy=0x7f81e00c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00be060 con 0x7f81e014b410 2020-11-20T11:29:24.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f81d00015f0 con 0x7f81e014b410 2020-11-20T11:29:24.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 >> v1:172.21.15.105:6789/0 conn(0x7f81e014b410 legacy=0x7f81e0065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8003960 0x7f81c8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80044e0 0x7f81c8004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 0x7f81c800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800bc20 con 0x7f81c8003960 2020-11-20T11:29:24.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800bd60 con 0x7f81c80044e0 2020-11-20T11:29:24.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800bf20 con 0x7f81c8004e50 2020-11-20T11:29:24.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.985+0000 7f81e603d700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 0x7f81c800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e503b700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80044e0 0x7f81c8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e583c700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8003960 0x7f81c8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 -- 172.21.15.105:0/3589613796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80044e0 msgr2=0x7f81c8004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:24.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80044e0 0x7f81c8004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 -- 172.21.15.105:0/3589613796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8003960 msgr2=0x7f81c8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:24.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8003960 0x7f81c8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 -- 172.21.15.105:0/3589613796 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003240 con 0x7f81c8004e50 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 -- 172.21.15.105:0/3589613796 reap_dead start 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e603d700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 0x7f81c800b730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f81d8009ea0 tx=0x7f81d80091d0).ready entity=mon.2 client_cookie=4fc94ecf93864eeb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80095c0 con 0x7f81c8004e50 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800ec40 con 0x7f81c8004e50 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e483a700 1 -- 172.21.15.105:0/3589613796 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8011450 con 0x7f81c8004e50 2020-11-20T11:29:24.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 msgr2=0x7f81c800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 0x7f81c800b730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f81d8009ea0 tx=0x7f81d80091d0).stop 2020-11-20T11:29:24.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3589613796 shutdown_connections 2020-11-20T11:29:24.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3589613796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c8004e50 0x7f81c800b730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.986+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3589613796 >> 172.21.15.105:0/3589613796 conn(0x7f81e00b9890 msgr2=0x7f81e00b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:24.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.987+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3589613796 shutdown_connections 2020-11-20T11:29:24.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.987+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3589613796 wait complete. 2020-11-20T11:29:24.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 Processor -- start 2020-11-20T11:29:24.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 -- start start 2020-11-20T11:29:24.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 0x7f81e0061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81e00c22d0 0x7f81e015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0062a50 con 0x7f81c8004e50 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00627b0 con 0x7f81e00c22d0 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e7aa0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c2b30 con 0x7f81e00c1e50 2020-11-20T11:29:24.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e503b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e503b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41248/0 (socket says 172.21.15.105:41248) 2020-11-20T11:29:24.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e503b700 1 -- 172.21.15.105:0/3945944732 learned_addr learned my addr 172.21.15.105:0/3945944732 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:24.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e583c700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 0x7f81e0061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.988+0000 7f81e603d700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81e00c22d0 0x7f81e015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 -- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81e00c22d0 msgr2=0x7f81e015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81e00c22d0 0x7f81e015c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 -- 172.21.15.105:0/3945944732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 msgr2=0x7f81e0061ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 0x7f81e0061ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 -- 172.21.15.105:0/3945944732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00c2dd0 con 0x7f81e00c1e50 2020-11-20T11:29:24.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e583c700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 0x7f81e0061ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:24.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e503b700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f81dc002ca0 tx=0x7f81dc007be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00fc30 con 0x7f81e00c1e50 2020-11-20T11:29:24.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc00fd90 con 0x7f81e00c1e50 2020-11-20T11:29:24.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc014680 con 0x7f81e00c1e50 2020-11-20T11:29:24.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00c3070 con 0x7f81e00c1e50 2020-11-20T11:29:24.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.989+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e00c37b0 con 0x7f81e00c1e50 2020-11-20T11:29:24.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.990+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e00c34d0 con 0x7f81e00c1e50 2020-11-20T11:29:24.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.990+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f81dc01b030 con 0x7f81e00c1e50 2020-11-20T11:29:24.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.991+0000 7f81cdffb700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 0x7f81b8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.991+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f81dc0a2460 con 0x7f81e00c1e50 2020-11-20T11:29:24.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.991+0000 7f81e583c700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 0x7f81b8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.991+0000 7f81e583c700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 0x7f81b8082af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f81d0001720 tx=0x7f81d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:23.994+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f81dc0774f0 con 0x7f81e00c1e50 2020-11-20T11:29:24.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.159+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f81e0044f60 con 0x7f81e00c1e50 2020-11-20T11:29:24.758 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.755+0000 7f81cdffb700 1 -- 172.21.15.105:0/3945944732 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f81dc07ab10 con 0x7f81e00c1e50 2020-11-20T11:29:24.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 msgr2=0x7f81b8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 0x7f81b8082af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f81d0001720 tx=0x7f81d0009040).stop 2020-11-20T11:29:24.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 msgr2=0x7f81e0146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f81dc002ca0 tx=0x7f81dc007be0).stop 2020-11-20T11:29:24.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 shutdown_connections 2020-11-20T11:29:24.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81e00c22d0 0x7f81e015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81c8004e50 0x7f81e0061ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f81b8080630 0x7f81b8082af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 --2- 172.21.15.105:0/3945944732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e00c1e50 0x7f81e0146420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 >> 172.21.15.105:0/3945944732 conn(0x7f81e00b9890 msgr2=0x7f81e00b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:24.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 shutdown_connections 2020-11-20T11:29:24.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.758+0000 7f81e7aa0700 1 -- 172.21.15.105:0/3945944732 wait complete. 2020-11-20T11:29:24.764 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'rbd' created 2020-11-20T11:29:24.773 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T11:29:24.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 Processor -- start 2020-11-20T11:29:24.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 -- start start 2020-11-20T11:29:24.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f41280c78d0 0x7f41280c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280c36f0 con 0x7f41281510d0 2020-11-20T11:29:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412809f5d0 con 0x7f41280626f0 2020-11-20T11:29:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.893+0000 7f412de64700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4128154860 con 0x7f41280c78d0 2020-11-20T11:29:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f41277fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f41280c78d0 0x7f41280c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f411ffff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f41280626f0 0x7f41280c2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40862/0 (socket says 172.21.15.105:40862) 2020-11-20T11:29:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f411ffff700 1 -- 172.21.15.105:0/1844693573 learned_addr learned my addr 172.21.15.105:0/1844693573 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f41277fe700 1 -- 172.21.15.105:0/1844693573 >> v1:172.21.15.105:6789/0 conn(0x7f41280626f0 legacy=0x7f41280c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f41277fe700 1 -- 172.21.15.105:0/1844693573 >> v1:172.21.15.100:6789/0 conn(0x7f41281510d0 legacy=0x7f4128151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f4126ffd700 1 -- 172.21.15.105:0/1844693573 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655577483 0 0) 0x7f412809f5d0 con 0x7f41280626f0 2020-11-20T11:29:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f41277fe700 1 -- 172.21.15.105:0/1844693573 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128154b00 con 0x7f41280c78d0 2020-11-20T11:29:24.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f41277fe700 1 --2- 172.21.15.105:0/1844693573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f41280c7cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f411800b9d0 tx=0x7f4118006df0).ready entity=mon.2 client_cookie=face65c29dc006c5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f4126ffd700 1 -- 172.21.15.105:0/1844693573 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180097f0 con 0x7f41280c78d0 2020-11-20T11:29:24.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f4126ffd700 1 -- 172.21.15.105:0/1844693573 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4118009950 con 0x7f41280c78d0 2020-11-20T11:29:24.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.894+0000 7f4126ffd700 1 -- 172.21.15.105:0/1844693573 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118009cd0 con 0x7f41280c78d0 2020-11-20T11:29:24.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 -- 172.21.15.105:0/1844693573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 msgr2=0x7f41280c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 --2- 172.21.15.105:0/1844693573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f41280c7cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f411800b9d0 tx=0x7f4118006df0).stop 2020-11-20T11:29:24.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 -- 172.21.15.105:0/1844693573 shutdown_connections 2020-11-20T11:29:24.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 --2- 172.21.15.105:0/1844693573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f41280c7cb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 -- 172.21.15.105:0/1844693573 >> 172.21.15.105:0/1844693573 conn(0x7f41280bdca0 msgr2=0x7f41280be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 -- 172.21.15.105:0/1844693573 shutdown_connections 2020-11-20T11:29:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.895+0000 7f412de64700 1 -- 172.21.15.105:0/1844693573 wait complete. 2020-11-20T11:29:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 Processor -- start 2020-11-20T11:29:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 -- start start 2020-11-20T11:29:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41280626f0 0x7f412814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41281510d0 0x7f4128157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412814cfe0 con 0x7f41281510d0 2020-11-20T11:29:24.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412814c2b0 con 0x7f41280626f0 2020-11-20T11:29:24.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.896+0000 7f412de64700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4128163dd0 con 0x7f41280c78d0 2020-11-20T11:29:24.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41266/0 (socket says 172.21.15.105:41266) 2020-11-20T11:29:24.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 -- 172.21.15.105:0/667773103 learned_addr learned my addr 172.21.15.105:0/667773103 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:24.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f41277fe700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41280626f0 0x7f412814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 -- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41280626f0 msgr2=0x7f412814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41280626f0 0x7f412814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:24.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 -- 172.21.15.105:0/667773103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41281510d0 msgr2=0x7f4128157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41281510d0 0x7f4128157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 -- 172.21.15.105:0/667773103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128164070 con 0x7f41280c78d0 2020-11-20T11:29:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411ffff700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f411000c760 tx=0x7f4110007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110007320 con 0x7f41280c78d0 2020-11-20T11:29:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110007480 con 0x7f41280c78d0 2020-11-20T11:29:24.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4128164310 con 0x7f41280c78d0 2020-11-20T11:29:24.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005820 con 0x7f41280c78d0 2020-11-20T11:29:24.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.897+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128164af0 con 0x7f41280c78d0 2020-11-20T11:29:24.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.898+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128044f60 con 0x7f41280c78d0 2020-11-20T11:29:24.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.899+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4110010030 con 0x7f41280c78d0 2020-11-20T11:29:24.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.899+0000 7f411f7fe700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 0x7f4104082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:24.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.899+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f41100a2270 con 0x7f41280c78d0 2020-11-20T11:29:24.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.899+0000 7f41277fe700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 0x7f4104082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:24.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.900+0000 7f41277fe700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 0x7f4104082af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4118006e30 tx=0x7f4118015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:24.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:24.903+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4110077150 con 0x7f41280c78d0 2020-11-20T11:29:25.069 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.066+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f412814e410 con 0x7f41280c78d0 2020-11-20T11:29:25.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.760+0000 7f411f7fe700 1 -- 172.21.15.105:0/667773103 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f411007a770 con 0x7f41280c78d0 2020-11-20T11:29:25.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 msgr2=0x7f4104082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 0x7f4104082af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4118006e30 tx=0x7f4118015000).stop 2020-11-20T11:29:25.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 msgr2=0x7f412814d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f411000c760 tx=0x7f4110007c90).stop 2020-11-20T11:29:25.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 shutdown_connections 2020-11-20T11:29:25.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41281510d0 0x7f4128157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:25.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41280626f0 0x7f412814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4104080630 0x7f4104082af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 --2- 172.21.15.105:0/667773103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41280c78d0 0x7f412814d6b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 >> 172.21.15.105:0/667773103 conn(0x7f41280bdca0 msgr2=0x7f41280c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:25.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 shutdown_connections 2020-11-20T11:29:25.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.762+0000 7f412de64700 1 -- 172.21.15.105:0/667773103 wait complete. 2020-11-20T11:29:25.768 INFO:teuthology.orchestra.run.smithi105.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T11:29:25.778 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T11:29:25.778 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T11:29:25.779 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T11:29:25.781 INFO:tasks.ceph.mds.a:Started 2020-11-20T11:29:25.781 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T11:29:25.782 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T11:29:25.784 INFO:tasks.ceph.mds.b:Started 2020-11-20T11:29:25.784 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T11:29:25.785 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T11:29:25.788 INFO:tasks.ceph.mds.c:Started 2020-11-20T11:29:25.788 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T11:29:25.789 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:25.857 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2020-11-20T11:29:25.865 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2020-11-20T11:29:25.876 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2020-11-20T11:29:25.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.908+0000 7ff5ab978700 1 Processor -- start 2020-11-20T11:29:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.908+0000 7ff5ab978700 1 -- start start 2020-11-20T11:29:25.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5ab978700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5a40c25b0 0x7ff5a4067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:25.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5ab978700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a4062260 con 0x7ff5a4061d20 2020-11-20T11:29:25.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5ab978700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a4062500 con 0x7ff5a4067380 2020-11-20T11:29:25.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5ab978700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40627a0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a9f15700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff5a4061d20 0x7ff5a40667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:52352/0 (socket says 172.21.15.105:52352) 2020-11-20T11:29:25.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a9f15700 1 -- 172.21.15.105:0/2276301450 learned_addr learned my addr 172.21.15.105:0/2276301450 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:25.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a8f13700 1 --2- 172.21.15.105:0/2276301450 >> v2:172.21.15.100:3300/0 conn(0x7ff5a40c25b0 0x7ff5a4067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:25.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff593fff700 1 -- 172.21.15.105:0/2276301450 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175854425 0 0) 0x7ff5a4062260 con 0x7ff5a4061d20 2020-11-20T11:29:25.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff593fff700 1 -- 172.21.15.105:0/2276301450 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c003240 con 0x7ff5a4061d20 2020-11-20T11:29:25.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a8f13700 1 -- 172.21.15.105:0/2276301450 >> v1:172.21.15.100:6789/0 conn(0x7ff5a4067380 legacy=0x7ff5a4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a8f13700 1 -- 172.21.15.105:0/2276301450 >> v1:172.21.15.67:6789/0 conn(0x7ff5a4061d20 legacy=0x7ff5a40667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a8f13700 1 -- 172.21.15.105:0/2276301450 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a41513e0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.909+0000 7ff5a8f13700 1 --2- 172.21.15.105:0/2276301450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4067760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff59400b9a0 tx=0x7ff594006df0).ready entity=mon.1 client_cookie=ebadf821a646a211 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff593fff700 1 -- 172.21.15.105:0/2276301450 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594009840 con 0x7ff5a40c25b0 2020-11-20T11:29:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff593fff700 1 -- 172.21.15.105:0/2276301450 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940099a0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff593fff700 1 -- 172.21.15.105:0/2276301450 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594009d20 con 0x7ff5a40c25b0 2020-11-20T11:29:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 -- 172.21.15.105:0/2276301450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a40c25b0 msgr2=0x7ff5a4067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2276301450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4067760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff59400b9a0 tx=0x7ff594006df0).stop 2020-11-20T11:29:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 -- 172.21.15.105:0/2276301450 shutdown_connections 2020-11-20T11:29:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2276301450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4067760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 -- 172.21.15.105:0/2276301450 >> 172.21.15.105:0/2276301450 conn(0x7ff5a40bdd20 msgr2=0x7ff5a40be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 -- 172.21.15.105:0/2276301450 shutdown_connections 2020-11-20T11:29:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.910+0000 7ff5ab978700 1 -- 172.21.15.105:0/2276301450 wait complete. 2020-11-20T11:29:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.911+0000 7ff5ab978700 1 Processor -- start 2020-11-20T11:29:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.911+0000 7ff5ab978700 1 -- start start 2020-11-20T11:29:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 0x7ff5a40c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4160710 con 0x7ff5a4061d20 2020-11-20T11:29:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41609b0 con 0x7ff5a4067380 2020-11-20T11:29:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5ab978700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4160c50 con 0x7ff5a40c25b0 2020-11-20T11:29:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a8f13700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41292/0 (socket says 172.21.15.105:41292) 2020-11-20T11:29:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 -- 172.21.15.105:0/2686575193 learned_addr learned my addr 172.21.15.105:0/2686575193 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a8f13700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59418/0 (socket says 172.21.15.105:59418) 2020-11-20T11:29:25.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9714700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 0x7ff5a40c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:25.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 -- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 msgr2=0x7ff5a4157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 -- 172.21.15.105:0/2686575193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 msgr2=0x7ff5a40c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:25.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 0x7ff5a40c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:25.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9f15700 1 -- 172.21.15.105:0/2686575193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4160ef0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a8f13700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:25.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.912+0000 7ff5a9714700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 0x7ff5a40c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:25.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5a9f15700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff59c001420 tx=0x7ff59c007e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:25.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c005b80 con 0x7ff5a40c25b0 2020-11-20T11:29:25.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c005ce0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c007320 con 0x7ff5a40c25b0 2020-11-20T11:29:25.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4161190 con 0x7ff5a40c25b0 2020-11-20T11:29:25.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.913+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41583d0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.914+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4044f60 con 0x7ff5a40c25b0 2020-11-20T11:29:25.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.914+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff59c010030 con 0x7ff5a40c25b0 2020-11-20T11:29:25.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.915+0000 7ff5917fa700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 0x7ff57c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.915+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff59c0a24e0 con 0x7ff5a40c25b0 2020-11-20T11:29:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.915+0000 7ff5a9714700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 0x7ff57c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.915+0000 7ff5a9714700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 0x7ff57c082b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff5a0001570 tx=0x7ff5a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:25.918+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff59c077410 con 0x7ff5a40c25b0 2020-11-20T11:29:26.085 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.082+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a4161320 con 0x7ff5a40c25b0 2020-11-20T11:29:26.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.082+0000 7ff5917fa700 1 -- 172.21.15.105:0/2686575193 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18391 (secure 0 0 0) 0x7ff59c07aa30 con 0x7ff5a40c25b0 2020-11-20T11:29:26.086 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:26.086 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":21,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:25.754338+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 msgr2=0x7ff57c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 0x7ff57c082b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff5a0001570 tx=0x7ff5a0009040).stop 2020-11-20T11:29:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 msgr2=0x7ff5a4156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff59c001420 tx=0x7ff59c007e20).stop 2020-11-20T11:29:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 shutdown_connections 2020-11-20T11:29:26.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff57c080660 0x7ff57c082b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a40c25b0 0x7ff5a4156c40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4061d20 0x7ff5a40c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 --2- 172.21.15.105:0/2686575193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5a4067380 0x7ff5a4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 >> 172.21.15.105:0/2686575193 conn(0x7ff5a40bdd20 msgr2=0x7ff5a4150500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 shutdown_connections 2020-11-20T11:29:26.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.084+0000 7ff5ab978700 1 -- 172.21.15.105:0/2686575193 wait complete. 2020-11-20T11:29:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:29:11.234336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:29:24.196669+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T11:29:26.099 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:29:26.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.216+0000 7efc44748700 1 Processor -- start 2020-11-20T11:29:26.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.216+0000 7efc44748700 1 -- start start 2020-11-20T11:29:26.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc44748700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc3c09ad30 0x7efc3c0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc44748700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc3c0c37f0 0x7efc3c14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc44748700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0bde30 con 0x7efc3c14b410 2020-11-20T11:29:26.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc44748700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0beae0 con 0x7efc3c09ad30 2020-11-20T11:29:26.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc44748700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c14de60 con 0x7efc3c0c37f0 2020-11-20T11:29:26.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc3c0c37f0 0x7efc3c14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc3c0c37f0 0x7efc3c14e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41300/0 (socket says 172.21.15.105:41300) 2020-11-20T11:29:26.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 -- 172.21.15.105:0/2948201420 learned_addr learned my addr 172.21.15.105:0/2948201420 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:26.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc41ce3700 1 --2- 172.21.15.105:0/2948201420 >> v2:172.21.15.100:3300/0 conn(0x7efc3c09ad30 0x7efc3c0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 -- 172.21.15.105:0/2948201420 >> v2:172.21.15.100:3300/0 conn(0x7efc3c09ad30 msgr2=0x7efc3c0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 --2- 172.21.15.105:0/2948201420 >> v2:172.21.15.100:3300/0 conn(0x7efc3c09ad30 0x7efc3c0c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 -- 172.21.15.105:0/2948201420 >> v1:172.21.15.67:6789/0 conn(0x7efc3c14b410 legacy=0x7efc3c065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 -- 172.21.15.105:0/2948201420 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c0be060 con 0x7efc3c0c37f0 2020-11-20T11:29:26.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc42ce5700 1 --2- 172.21.15.105:0/2948201420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c0c37f0 0x7efc3c14e2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7efc3c067c70 tx=0x7efc34009290).ready entity=mon.2 client_cookie=39c96e47c7a97763 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc414e2700 1 -- 172.21.15.105:0/2948201420 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400bbc0 con 0x7efc3c0c37f0 2020-11-20T11:29:26.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc414e2700 1 -- 172.21.15.105:0/2948201420 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400bd20 con 0x7efc3c0c37f0 2020-11-20T11:29:26.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.217+0000 7efc414e2700 1 -- 172.21.15.105:0/2948201420 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011610 con 0x7efc3c0c37f0 2020-11-20T11:29:26.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 -- 172.21.15.105:0/2948201420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c0c37f0 msgr2=0x7efc3c14e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 --2- 172.21.15.105:0/2948201420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c0c37f0 0x7efc3c14e2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7efc3c067c70 tx=0x7efc34009290).stop 2020-11-20T11:29:26.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 -- 172.21.15.105:0/2948201420 shutdown_connections 2020-11-20T11:29:26.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 --2- 172.21.15.105:0/2948201420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c0c37f0 0x7efc3c14e2a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 --2- 172.21.15.105:0/2948201420 >> v2:172.21.15.100:3300/0 conn(0x7efc3c09ad30 0x7efc3c0c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 -- 172.21.15.105:0/2948201420 >> 172.21.15.105:0/2948201420 conn(0x7efc3c0b9890 msgr2=0x7efc3c0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 -- 172.21.15.105:0/2948201420 shutdown_connections 2020-11-20T11:29:26.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.218+0000 7efc44748700 1 -- 172.21.15.105:0/2948201420 wait complete. 2020-11-20T11:29:26.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.219+0000 7efc44748700 1 Processor -- start 2020-11-20T11:29:26.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.219+0000 7efc44748700 1 -- start start 2020-11-20T11:29:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc3c0c37f0 0x7efc3c160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc3c14b410 0x7efc3c161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1642b0 con 0x7efc3c14b410 2020-11-20T11:29:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c164550 con 0x7efc3c0c37f0 2020-11-20T11:29:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1647f0 con 0x7efc3c09ad30 2020-11-20T11:29:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41302/0 (socket says 172.21.15.105:41302) 2020-11-20T11:29:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 -- 172.21.15.105:0/738216022 learned_addr learned my addr 172.21.15.105:0/738216022 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:26.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc41ce3700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc3c0c37f0 0x7efc3c160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc42ce5700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc3c14b410 0x7efc3c161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 -- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc3c0c37f0 msgr2=0x7efc3c160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc3c0c37f0 0x7efc3c160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 -- 172.21.15.105:0/738216022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc3c14b410 msgr2=0x7efc3c161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc3c14b410 0x7efc3c161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 -- 172.21.15.105:0/738216022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c164a90 con 0x7efc3c09ad30 2020-11-20T11:29:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc424e4700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efc3800c710 tx=0x7efc38007c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800e490 con 0x7efc3c09ad30 2020-11-20T11:29:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800e5f0 con 0x7efc3c09ad30 2020-11-20T11:29:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c161c70 con 0x7efc3c09ad30 2020-11-20T11:29:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800e990 con 0x7efc3c09ad30 2020-11-20T11:29:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.220+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c062570 con 0x7efc3c09ad30 2020-11-20T11:29:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.221+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c1607c0 con 0x7efc3c09ad30 2020-11-20T11:29:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.222+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efc38010030 con 0x7efc3c09ad30 2020-11-20T11:29:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.222+0000 7efc2a7fc700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 0x7efc14082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.223+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7efc380a2220 con 0x7efc3c09ad30 2020-11-20T11:29:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.223+0000 7efc41ce3700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 0x7efc14082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.223+0000 7efc41ce3700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 0x7efc14082af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efc3c13b1f0 tx=0x7efc2c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.226+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efc38077150 con 0x7efc3c09ad30 2020-11-20T11:29:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.388+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efc3c044f60 con 0x7efc3c09ad30 2020-11-20T11:29:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.388+0000 7efc2a7fc700 1 -- 172.21.15.105:0/738216022 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7efc3807a770 con 0x7efc3c09ad30 2020-11-20T11:29:26.392 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2020-11-20T11:29:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 msgr2=0x7efc14082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 0x7efc14082af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efc3c13b1f0 tx=0x7efc2c008040).stop 2020-11-20T11:29:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 msgr2=0x7efc3c061ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efc3800c710 tx=0x7efc38007c00).stop 2020-11-20T11:29:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 shutdown_connections 2020-11-20T11:29:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc3c14b410 0x7efc3c161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efc14080630 0x7efc14082af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc3c09ad30 0x7efc3c061ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 --2- 172.21.15.105:0/738216022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc3c0c37f0 0x7efc3c160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 >> 172.21.15.105:0/738216022 conn(0x7efc3c0b9890 msgr2=0x7efc3c066820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.395 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 shutdown_connections 2020-11-20T11:29:26.396 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.390+0000 7efc44748700 1 -- 172.21.15.105:0/738216022 wait complete. 2020-11-20T11:29:26.404 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:29:26.525 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.521+0000 7f27284db700 1 Processor -- start 2020-11-20T11:29:26.525 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.521+0000 7f27284db700 1 -- start start 2020-11-20T11:29:26.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f27284db700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f272014b410 0x7f2720065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f27284db700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f272009ad30 0x7f2720065a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f27284db700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200bde30 con 0x7f27200c3300 2020-11-20T11:29:26.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f27284db700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200beae0 con 0x7f272009ad30 2020-11-20T11:29:26.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f27284db700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272014de60 con 0x7f272014b410 2020-11-20T11:29:26.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f2726277700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f272014b410 0x7f2720065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f2726277700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f272014b410 0x7f2720065570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41310/0 (socket says 172.21.15.105:41310) 2020-11-20T11:29:26.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.522+0000 7f2726277700 1 -- 172.21.15.105:0/2560000925 learned_addr learned my addr 172.21.15.105:0/2560000925 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:26.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2725a76700 1 --2- 172.21.15.105:0/2560000925 >> v2:172.21.15.67:3300/0 conn(0x7f272009ad30 0x7f2720065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2726277700 1 -- 172.21.15.105:0/2560000925 >> v2:172.21.15.67:3300/0 conn(0x7f272009ad30 msgr2=0x7f2720065a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2726277700 1 --2- 172.21.15.105:0/2560000925 >> v2:172.21.15.67:3300/0 conn(0x7f272009ad30 0x7f2720065a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2726277700 1 -- 172.21.15.105:0/2560000925 >> v1:172.21.15.100:6789/0 conn(0x7f27200c3300 legacy=0x7f27200c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2726277700 1 -- 172.21.15.105:0/2560000925 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200be060 con 0x7f272014b410 2020-11-20T11:29:26.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2726277700 1 --2- 172.21.15.105:0/2560000925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272014b410 0x7f2720065570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2720026ed0 tx=0x7f2710006eb0).ready entity=mon.2 client_cookie=83618591618c2138 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2725275700 1 -- 172.21.15.105:0/2560000925 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710009890 con 0x7f272014b410 2020-11-20T11:29:26.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2725275700 1 -- 172.21.15.105:0/2560000925 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100099f0 con 0x7f272014b410 2020-11-20T11:29:26.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f2725275700 1 -- 172.21.15.105:0/2560000925 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710009d70 con 0x7f272014b410 2020-11-20T11:29:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 -- 172.21.15.105:0/2560000925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272014b410 msgr2=0x7f2720065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 --2- 172.21.15.105:0/2560000925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272014b410 0x7f2720065570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2720026ed0 tx=0x7f2710006eb0).stop 2020-11-20T11:29:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 -- 172.21.15.105:0/2560000925 shutdown_connections 2020-11-20T11:29:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 --2- 172.21.15.105:0/2560000925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272014b410 0x7f2720065570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 --2- 172.21.15.105:0/2560000925 >> v2:172.21.15.67:3300/0 conn(0x7f272009ad30 0x7f2720065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 -- 172.21.15.105:0/2560000925 >> 172.21.15.105:0/2560000925 conn(0x7f27200b9890 msgr2=0x7f27200b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.523+0000 7f27284db700 1 -- 172.21.15.105:0/2560000925 shutdown_connections 2020-11-20T11:29:26.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.524+0000 7f27284db700 1 -- 172.21.15.105:0/2560000925 wait complete. 2020-11-20T11:29:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 Processor -- start 2020-11-20T11:29:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 -- start start 2020-11-20T11:29:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 0x7f27200622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 0x7f272009a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272014fd50 con 0x7f272009ad30 2020-11-20T11:29:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200627e0 con 0x7f272014b410 2020-11-20T11:29:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f27284db700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272014fab0 con 0x7f27200c3300 2020-11-20T11:29:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f2725a76700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f2725a76700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41320/0 (socket says 172.21.15.105:41320) 2020-11-20T11:29:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.525+0000 7f2725a76700 1 -- 172.21.15.105:0/552280055 learned_addr learned my addr 172.21.15.105:0/552280055 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2726277700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 0x7f27200622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2726a78700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 0x7f272009a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 -- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 msgr2=0x7f272009a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 0x7f272009a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 -- 172.21.15.105:0/552280055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 msgr2=0x7f27200622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 0x7f27200622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 -- 172.21.15.105:0/552280055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720163fd0 con 0x7f27200c3300 2020-11-20T11:29:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2726a78700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 0x7f272009a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2726277700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 0x7f27200622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f2725a76700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f271c00d910 tx=0x7f271c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009820 con 0x7f27200c3300 2020-11-20T11:29:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c009980 con 0x7f27200c3300 2020-11-20T11:29:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009d00 con 0x7f27200c3300 2020-11-20T11:29:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2720164270 con 0x7f27200c3300 2020-11-20T11:29:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.526+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27201647b0 con 0x7f27200c3300 2020-11-20T11:29:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.527+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2720164970 con 0x7f27200c3300 2020-11-20T11:29:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.527+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f271c013690 con 0x7f27200c3300 2020-11-20T11:29:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.528+0000 7f270e7fc700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 0x7f26f8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.528+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f271c0a2c40 con 0x7f27200c3300 2020-11-20T11:29:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.528+0000 7f2726277700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 0x7f26f8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.528+0000 7f2726277700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 0x7f26f8082af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2720161980 tx=0x7f2710015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.531+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f271c077b70 con 0x7f27200c3300 2020-11-20T11:29:26.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.700+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2720044f60 con 0x7f27200c3300 2020-11-20T11:29:26.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.700+0000 7f270e7fc700 1 -- 172.21.15.105:0/552280055 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f271c009e60 con 0x7f27200c3300 2020-11-20T11:29:26.704 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:26.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 msgr2=0x7f26f8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 0x7f26f8082af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2720161980 tx=0x7f2710015000).stop 2020-11-20T11:29:26.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 msgr2=0x7f272009a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f271c00d910 tx=0x7f271c008040).stop 2020-11-20T11:29:26.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 shutdown_connections 2020-11-20T11:29:26.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272014b410 0x7f272009a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272009ad30 0x7f27200622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f26f8080630 0x7f26f8082af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 --2- 172.21.15.105:0/552280055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27200c3300 0x7f272009a110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 >> 172.21.15.105:0/552280055 conn(0x7f27200b9890 msgr2=0x7f27200c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 shutdown_connections 2020-11-20T11:29:26.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.702+0000 7f27284db700 1 -- 172.21.15.105:0/552280055 wait complete. 2020-11-20T11:29:26.717 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T11:29:26.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 Processor -- start 2020-11-20T11:29:26.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 -- start start 2020-11-20T11:29:26.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f71040656e0 0x7f71040c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040bc220 con 0x7f71040ba2e0 2020-11-20T11:29:26.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710414ddc0 con 0x7f71040bfea0 2020-11-20T11:29:26.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.832+0000 7f7109f9f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040bc4c0 con 0x7f71040656e0 2020-11-20T11:29:26.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f7108f9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f71040bfea0 0x7f7104064fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40928/0 (socket says 172.21.15.105:40928) 2020-11-20T11:29:26.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f7108f9d700 1 -- 172.21.15.105:0/1127451271 learned_addr learned my addr 172.21.15.105:0/1127451271 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:26.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f7103fff700 1 --2- 172.21.15.105:0/1127451271 >> v2:172.21.15.67:3300/0 conn(0x7f71040656e0 0x7f71040c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314198793 0 0) 0x7f710414ddc0 con 0x7f71040bfea0 2020-11-20T11:29:26.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e4003240 con 0x7f71040bfea0 2020-11-20T11:29:26.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2086771922 0 0) 0x7f70e4003240 con 0x7f71040bfea0 2020-11-20T11:29:26.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 >> v2:172.21.15.67:3300/0 conn(0x7f71040656e0 msgr2=0x7f71040c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 --2- 172.21.15.105:0/1127451271 >> v2:172.21.15.67:3300/0 conn(0x7f71040656e0 0x7f71040c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 >> v1:172.21.15.67:6789/0 conn(0x7f71040ba2e0 legacy=0x7f710414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710414e060 con 0x7f71040bfea0 2020-11-20T11:29:26.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f70fc001860 con 0x7f71040bfea0 2020-11-20T11:29:26.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 >> v1:172.21.15.105:6789/0 conn(0x7f71040bfea0 legacy=0x7f7104064fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f70e4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e40044e0 0x7f70e4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e4004e50 0x7f70e400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040bc4c0 con 0x7f70e4004e50 2020-11-20T11:29:26.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4005300 con 0x7f70e40044e0 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e400bc20 con 0x7f70e4003780 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f7108f9d700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f70e4003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f710979e700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e4004e50 0x7f70e400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.833+0000 7f7103fff700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e40044e0 0x7f70e4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 -- 172.21.15.105:0/1127451271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e40044e0 msgr2=0x7f70e4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e40044e0 0x7f70e4004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 -- 172.21.15.105:0/1127451271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e4004e50 msgr2=0x7f70e400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:26.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e4004e50 0x7f70e400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f710979e700 1 -- 172.21.15.105:0/1127451271 reap_dead start 2020-11-20T11:29:26.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 -- 172.21.15.105:0/1127451271 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4003240 con 0x7f70e4003780 2020-11-20T11:29:26.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7103fff700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e40044e0 0x7f70e4004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7108f9d700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f70e4003ba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f70fc00c840 tx=0x7f710414df50).ready entity=mon.2 client_cookie=cc2b4aa82bbaee7a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc005b80 con 0x7f70e4003780 2020-11-20T11:29:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc005ce0 con 0x7f70e4003780 2020-11-20T11:29:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f71037fe700 1 -- 172.21.15.105:0/1127451271 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0072e0 con 0x7f70e4003780 2020-11-20T11:29:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 -- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 msgr2=0x7f70e4003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f70e4003ba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f70fc00c840 tx=0x7f710414df50).stop 2020-11-20T11:29:26.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 -- 172.21.15.105:0/1127451271 shutdown_connections 2020-11-20T11:29:26.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 --2- 172.21.15.105:0/1127451271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f70e4003ba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 -- 172.21.15.105:0/1127451271 >> 172.21.15.105:0/1127451271 conn(0x7f7104025a60 msgr2=0x7f7104025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:26.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 -- 172.21.15.105:0/1127451271 shutdown_connections 2020-11-20T11:29:26.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.834+0000 7f7109f9f700 1 -- 172.21.15.105:0/1127451271 wait complete. 2020-11-20T11:29:26.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.835+0000 7f7109f9f700 1 Processor -- start 2020-11-20T11:29:26.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 -- start start 2020-11-20T11:29:26.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 0x7f7104149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 0x7f71041484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b0ca0 con 0x7f7104149c40 2020-11-20T11:29:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b0a00 con 0x7f71041546d0 2020-11-20T11:29:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7109f9f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104160500 con 0x7f70e4003780 2020-11-20T11:29:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7108f9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7108f9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41336/0 (socket says 172.21.15.105:41336) 2020-11-20T11:29:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.836+0000 7f7108f9d700 1 -- 172.21.15.105:0/2946227474 learned_addr learned my addr 172.21.15.105:0/2946227474 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7103fff700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 0x7f7104149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f710979e700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 0x7f71041484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 -- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 msgr2=0x7f7104149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 0x7f7104149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 -- 172.21.15.105:0/2946227474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 msgr2=0x7f71041484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 0x7f71041484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 -- 172.21.15.105:0/2946227474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71041607a0 con 0x7f70e4003780 2020-11-20T11:29:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7103fff700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 0x7f7104149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f710979e700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 0x7f71041484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7108f9d700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f70fc001150 tx=0x7f70fc010000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0072e0 con 0x7f70e4003780 2020-11-20T11:29:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc007690 con 0x7f70e4003780 2020-11-20T11:29:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7104160a40 con 0x7f70e4003780 2020-11-20T11:29:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0138b0 con 0x7f70e4003780 2020-11-20T11:29:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.837+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104161180 con 0x7f70e4003780 2020-11-20T11:29:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.838+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710405ca10 con 0x7f70e4003780 2020-11-20T11:29:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.839+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f70fc026070 con 0x7f70e4003780 2020-11-20T11:29:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.839+0000 7f7100ff9700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 0x7f70e0082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.839+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f70fc0a3280 con 0x7f70e4003780 2020-11-20T11:29:26.860 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.839+0000 7f7103fff700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 0x7f70e0082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:26.860 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.840+0000 7f7103fff700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 0x7f70e0082b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f70f4006a90 tx=0x7f70f4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:26.860 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:26.842+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f70fc0781b0 con 0x7f70e4003780 2020-11-20T11:29:27.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.008+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71040bedf0 con 0x7f70e4003780 2020-11-20T11:29:27.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.008+0000 7f7100ff9700 1 -- 172.21.15.105:0/2946227474 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7f70fc07b7d0 con 0x7f70e4003780 2020-11-20T11:29:27.012 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:27.013 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2020-11-20T11:29:27.013 INFO:teuthology.orchestra.run.smithi105.stdout: { 2020-11-20T11:29:27.013 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2020-11-20T11:29:27.013 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": "device_health_metrics" 2020-11-20T11:29:27.013 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:29:27.014 INFO:teuthology.orchestra.run.smithi105.stdout: { 2020-11-20T11:29:27.014 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 2, 2020-11-20T11:29:27.014 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": "rbd" 2020-11-20T11:29:27.014 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:29:27.014 INFO:teuthology.orchestra.run.smithi105.stdout:] 2020-11-20T11:29:27.015 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 msgr2=0x7f70e0082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.016 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 0x7f70e0082b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f70f4006a90 tx=0x7f70f4008040).stop 2020-11-20T11:29:27.016 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 msgr2=0x7f71040b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.016 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f70fc001150 tx=0x7f70fc010000).stop 2020-11-20T11:29:27.016 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 shutdown_connections 2020-11-20T11:29:27.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7104149c40 0x7f71041484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f70e0080660 0x7f70e0082b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70e4003780 0x7f71040b0420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 --2- 172.21.15.105:0/2946227474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71041546d0 0x7f7104149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 >> 172.21.15.105:0/2946227474 conn(0x7f7104025a60 msgr2=0x7f7104025e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:27.018 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 shutdown_connections 2020-11-20T11:29:27.018 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.010+0000 7f7109f9f700 1 -- 172.21.15.105:0/2946227474 wait complete. 2020-11-20T11:29:27.024 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T11:29:27.025 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T11:29:27.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.141+0000 7f47081e0700 1 Processor -- start 2020-11-20T11:29:27.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.141+0000 7f47081e0700 1 -- start start 2020-11-20T11:29:27.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4700025c20 0x7f4700026000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 0x7f47000bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47000632f0 0x7f4700063780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47001516a0 con 0x7f47000632f0 2020-11-20T11:29:27.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4700151940 con 0x7f47000bb660 2020-11-20T11:29:27.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f47081e0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4700151be0 con 0x7f4700025c20 2020-11-20T11:29:27.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4700025c20 0x7f4700026000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4700025c20 0x7f4700026000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41344/0 (socket says 172.21.15.105:41344) 2020-11-20T11:29:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 -- 172.21.15.105:0/1337276056 learned_addr learned my addr 172.21.15.105:0/1337276056 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f470677d700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.67:3300/0 conn(0x7f47000632f0 0x7f4700063780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f470577b700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 0x7f47000bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 -- 172.21.15.105:0/1337276056 >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 msgr2=0x7f47000bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 0x7f47000bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 -- 172.21.15.105:0/1337276056 >> v2:172.21.15.67:3300/0 conn(0x7f47000632f0 msgr2=0x7f4700063780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:27.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.67:3300/0 conn(0x7f47000632f0 0x7f4700063780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f4705f7c700 1 -- 172.21.15.105:0/1337276056 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700151e80 con 0x7f4700025c20 2020-11-20T11:29:27.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.142+0000 7f470577b700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 0x7f47000bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:27.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f4705f7c700 1 --2- 172.21.15.105:0/1337276056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4700025c20 0x7f4700026000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f47000264f0 tx=0x7f46f0006eb0).ready entity=mon.2 client_cookie=fa7412f74b45f515 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f4704f7a700 1 -- 172.21.15.105:0/1337276056 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0009810 con 0x7f4700025c20 2020-11-20T11:29:27.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f4704f7a700 1 -- 172.21.15.105:0/1337276056 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0009970 con 0x7f4700025c20 2020-11-20T11:29:27.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f4704f7a700 1 -- 172.21.15.105:0/1337276056 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0009cf0 con 0x7f4700025c20 2020-11-20T11:29:27.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 -- 172.21.15.105:0/1337276056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4700025c20 msgr2=0x7f4700026000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 --2- 172.21.15.105:0/1337276056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4700025c20 0x7f4700026000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f47000264f0 tx=0x7f46f0006eb0).stop 2020-11-20T11:29:27.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 -- 172.21.15.105:0/1337276056 shutdown_connections 2020-11-20T11:29:27.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.67:3300/0 conn(0x7f47000632f0 0x7f4700063780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 --2- 172.21.15.105:0/1337276056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4700025c20 0x7f4700026000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 --2- 172.21.15.105:0/1337276056 >> v2:172.21.15.100:3300/0 conn(0x7f47000bb660 0x7f47000bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 -- 172.21.15.105:0/1337276056 >> 172.21.15.105:0/1337276056 conn(0x7f47000c4520 msgr2=0x7f47000c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:27.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 -- 172.21.15.105:0/1337276056 shutdown_connections 2020-11-20T11:29:27.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.143+0000 7f47081e0700 1 -- 172.21.15.105:0/1337276056 wait complete. 2020-11-20T11:29:27.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.144+0000 7f47081e0700 1 Processor -- start 2020-11-20T11:29:27.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.144+0000 7f47081e0700 1 -- start start 2020-11-20T11:29:27.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 0x7f4700152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47000632f0 0x7f4700164da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47000c5440 con 0x7f4700025c20 2020-11-20T11:29:27.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4700155b70 con 0x7f47000632f0 2020-11-20T11:29:27.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f47081e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4700155e10 con 0x7f47000bb660 2020-11-20T11:29:27.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f470677d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f470677d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41354/0 (socket says 172.21.15.105:41354) 2020-11-20T11:29:27.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f470677d700 1 -- 172.21.15.105:0/2962575433 learned_addr learned my addr 172.21.15.105:0/2962575433 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:27.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f470577b700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47000632f0 0x7f4700164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.145+0000 7f4705f7c700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 0x7f4700152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 -- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47000632f0 msgr2=0x7f4700164da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47000632f0 0x7f4700164da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 -- 172.21.15.105:0/2962575433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 msgr2=0x7f4700152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 0x7f4700152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 -- 172.21.15.105:0/2962575433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47001643c0 con 0x7f47000bb660 2020-11-20T11:29:27.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f4705f7c700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 0x7f4700152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:27.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f470677d700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f46f800ef50 tx=0x7f46f80091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f800cd20 con 0x7f47000bb660 2020-11-20T11:29:27.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f800ce80 con 0x7f47000bb660 2020-11-20T11:29:27.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4700164660 con 0x7f47000bb660 2020-11-20T11:29:27.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8012620 con 0x7f47000bb660 2020-11-20T11:29:27.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.146+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4700155860 con 0x7f47000bb660 2020-11-20T11:29:27.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.147+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700152320 con 0x7f47000bb660 2020-11-20T11:29:27.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.148+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f46f8022070 con 0x7f47000bb660 2020-11-20T11:29:27.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.148+0000 7f46edffb700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 0x7f46dc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.148+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f46f80a2e40 con 0x7f47000bb660 2020-11-20T11:29:27.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.148+0000 7f4705f7c700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 0x7f46dc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.148+0000 7f4705f7c700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 0x7f46dc082af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f47000264f0 tx=0x7f46f0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.151+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f46f8077d70 con 0x7f47000bb660 2020-11-20T11:29:27.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.316+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f47000be7d0 con 0x7f47000bb660 2020-11-20T11:29:27.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.768+0000 7f46edffb700 1 -- 172.21.15.105:0/2962575433 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v23) v1 ==== 133+0+0 (secure 0 0 0) 0x7f46f8016030 con 0x7f47000bb660 2020-11-20T11:29:27.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 msgr2=0x7f46dc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 0x7f46dc082af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f47000264f0 tx=0x7f46f0015000).stop 2020-11-20T11:29:27.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 msgr2=0x7f470014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f46f800ef50 tx=0x7f46f80091d0).stop 2020-11-20T11:29:27.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 shutdown_connections 2020-11-20T11:29:27.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46dc080630 0x7f46dc082af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47000bb660 0x7f470014bea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4700025c20 0x7f4700152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 --2- 172.21.15.105:0/2962575433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47000632f0 0x7f4700164da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 >> 172.21.15.105:0/2962575433 conn(0x7f47000c4520 msgr2=0x7f47000c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:27.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 shutdown_connections 2020-11-20T11:29:27.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.770+0000 7f47081e0700 1 -- 172.21.15.105:0/2962575433 wait complete. 2020-11-20T11:29:27.777 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2020-11-20T11:29:27.786 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T11:29:27.786 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T11:29:27.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.906+0000 7f74f7ce7700 1 Processor -- start 2020-11-20T11:29:27.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f7ce7700 1 -- start start 2020-11-20T11:29:27.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f7ce7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74f00c3a10 0x7f74f014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f7ce7700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f00bde30 con 0x7f74f014b410 2020-11-20T11:29:27.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f7ce7700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f014de60 con 0x7f74f009ad30 2020-11-20T11:29:27.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f7ce7700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f00beae0 con 0x7f74f00c3a10 2020-11-20T11:29:27.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.907+0000 7f74f5282700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f74f009ad30 0x7f74f00c3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40962/0 (socket says 172.21.15.105:40962) 2020-11-20T11:29:27.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f5282700 1 -- 172.21.15.105:0/720267120 learned_addr learned my addr 172.21.15.105:0/720267120 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:27.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 --2- 172.21.15.105:0/720267120 >> v2:172.21.15.100:3300/0 conn(0x7f74f00c3a10 0x7f74f014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646898226 0 0) 0x7f74ec001250 con 0x7f74f009ad30 2020-11-20T11:29:27.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d8003240 con 0x7f74f009ad30 2020-11-20T11:29:27.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1302243076 0 0) 0x7f74d8003240 con 0x7f74f009ad30 2020-11-20T11:29:27.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 >> v2:172.21.15.100:3300/0 conn(0x7f74f00c3a10 msgr2=0x7f74f014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:27.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 --2- 172.21.15.105:0/720267120 >> v2:172.21.15.100:3300/0 conn(0x7f74f00c3a10 0x7f74f014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 >> v1:172.21.15.100:6789/0 conn(0x7f74f014b410 legacy=0x7f74f0065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00be060 con 0x7f74f009ad30 2020-11-20T11:29:27.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f74ec0017f0 con 0x7f74f009ad30 2020-11-20T11:29:27.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 >> v1:172.21.15.105:6789/0 conn(0x7f74f009ad30 legacy=0x7f74f00c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d8003730 0x7f74d8003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d80044e0 0x7f74d8004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74d800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8004220 con 0x7f74d8003730 2020-11-20T11:29:27.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800bc20 con 0x7f74d80044e0 2020-11-20T11:29:27.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800bd60 con 0x7f74d8004e50 2020-11-20T11:29:27.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74d800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f5282700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d80044e0 0x7f74d8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f5a83700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d8003730 0x7f74d8003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 -- 172.21.15.105:0/720267120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d80044e0 msgr2=0x7f74d8004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:27.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d80044e0 0x7f74d8004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 -- 172.21.15.105:0/720267120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d8003730 msgr2=0x7f74d8003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:27.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d8003730 0x7f74d8003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.908+0000 7f74f6284700 1 -- 172.21.15.105:0/720267120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8003240 con 0x7f74d8004e50 2020-11-20T11:29:27.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f6284700 1 -- 172.21.15.105:0/720267120 reap_dead start 2020-11-20T11:29:27.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f6284700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74d800b730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f74e8009ea0 tx=0x7f74e80091d0).ready entity=mon.2 client_cookie=775f065da1bb7237 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e80095c0 con 0x7f74d8004e50 2020-11-20T11:29:27.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e800ecf0 con 0x7f74d8004e50 2020-11-20T11:29:27.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f4a81700 1 -- 172.21.15.105:0/720267120 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8012640 con 0x7f74d8004e50 2020-11-20T11:29:27.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 -- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 msgr2=0x7f74d800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74d800b730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f74e8009ea0 tx=0x7f74e80091d0).stop 2020-11-20T11:29:27.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 -- 172.21.15.105:0/720267120 shutdown_connections 2020-11-20T11:29:27.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/720267120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74d800b730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 -- 172.21.15.105:0/720267120 >> 172.21.15.105:0/720267120 conn(0x7f74f00b9890 msgr2=0x7f74f00b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:27.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 -- 172.21.15.105:0/720267120 shutdown_connections 2020-11-20T11:29:27.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.909+0000 7f74f7ce7700 1 -- 172.21.15.105:0/720267120 wait complete. 2020-11-20T11:29:27.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.910+0000 7f74f7ce7700 1 Processor -- start 2020-11-20T11:29:27.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.910+0000 7f74f7ce7700 1 -- start start 2020-11-20T11:29:27.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f014d6c0 0x7f74f00c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74f014b7f0 0x7f74f013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0151460 con 0x7f74f014d6c0 2020-11-20T11:29:27.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0151700 con 0x7f74f014b7f0 2020-11-20T11:29:27.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f7ce7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0161dc0 con 0x7f74d8004e50 2020-11-20T11:29:27.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41368/0 (socket says 172.21.15.105:41368) 2020-11-20T11:29:27.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 -- 172.21.15.105:0/4262435947 learned_addr learned my addr 172.21.15.105:0/4262435947 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:27.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f6284700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74f014b7f0 0x7f74f013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5282700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f014d6c0 0x7f74f00c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 -- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74f014b7f0 msgr2=0x7f74f013d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74f014b7f0 0x7f74f013d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 -- 172.21.15.105:0/4262435947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f014d6c0 msgr2=0x7f74f00c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:27.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f014d6c0 0x7f74f00c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:27.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.911+0000 7f74f5a83700 1 -- 172.21.15.105:0/4262435947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0162060 con 0x7f74d8004e50 2020-11-20T11:29:27.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74f5a83700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f74e000e700 tx=0x7f74e0009040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0010550 con 0x7f74d8004e50 2020-11-20T11:29:27.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0010040 con 0x7f74d8004e50 2020-11-20T11:29:27.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f0162300 con 0x7f74d8004e50 2020-11-20T11:29:27.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00108c0 con 0x7f74d8004e50 2020-11-20T11:29:27.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.912+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f00c3190 con 0x7f74d8004e50 2020-11-20T11:29:27.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.913+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f00baf80 con 0x7f74d8004e50 2020-11-20T11:29:27.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.913+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f74e001b030 con 0x7f74d8004e50 2020-11-20T11:29:27.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.914+0000 7f74ddffb700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 0x7f74cc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:27.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.914+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f74e00a1c00 con 0x7f74d8004e50 2020-11-20T11:29:27.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.914+0000 7f74f5282700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 0x7f74cc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:27.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.914+0000 7f74f5282700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 0x7f74cc082af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f74ec0079d0 tx=0x7f74ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:27.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:27.917+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f74e0045fd0 con 0x7f74d8004e50 2020-11-20T11:29:28.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.091+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f74f0044f60 con 0x7f74d8004e50 2020-11-20T11:29:28.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.773+0000 7f74ddffb700 1 -- 172.21.15.105:0/4262435947 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 154+0+0 (secure 0 0 0) 0x7f74e00a7020 con 0x7f74d8004e50 2020-11-20T11:29:28.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 msgr2=0x7f74cc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 0x7f74cc082af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f74ec0079d0 tx=0x7f74ec009040).stop 2020-11-20T11:29:28.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 msgr2=0x7f74f01627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f74e000e700 tx=0x7f74e0009040).stop 2020-11-20T11:29:28.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 shutdown_connections 2020-11-20T11:29:28.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74f014b7f0 0x7f74f013d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f74cc080630 0x7f74cc082af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d8004e50 0x7f74f01627a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 --2- 172.21.15.105:0/4262435947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f014d6c0 0x7f74f00c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 >> 172.21.15.105:0/4262435947 conn(0x7f74f00b9890 msgr2=0x7f74f0025a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:28.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 shutdown_connections 2020-11-20T11:29:28.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.776+0000 7f74f7ce7700 1 -- 172.21.15.105:0/4262435947 wait complete. 2020-11-20T11:29:28.795 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T11:29:28.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.918+0000 7fb8cadd3700 1 Processor -- start 2020-11-20T11:29:28.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.918+0000 7fb8cadd3700 1 -- start start 2020-11-20T11:29:28.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8cadd3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb8c409ad30 0x7fb8c40c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8cadd3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8c40c37f0 0x7fb8c414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8cadd3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40bde30 con 0x7fb8c414b410 2020-11-20T11:29:28.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8cadd3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c40beae0 con 0x7fb8c409ad30 2020-11-20T11:29:28.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8cadd3700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c414de60 con 0x7fb8c40c37f0 2020-11-20T11:29:28.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8c3fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb8c409ad30 0x7fb8c40c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8c8b6f700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb8c414b410 0x7fb8c4065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:52446/0 (socket says 172.21.15.105:52446) 2020-11-20T11:29:28.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8c8b6f700 1 -- 172.21.15.105:0/1624967888 learned_addr learned my addr 172.21.15.105:0/1624967888 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:28.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.919+0000 7fb8c9370700 1 --2- 172.21.15.105:0/1624967888 >> v2:172.21.15.100:3300/0 conn(0x7fb8c40c37f0 0x7fb8c414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c3fff700 1 -- 172.21.15.105:0/1624967888 >> v2:172.21.15.100:3300/0 conn(0x7fb8c40c37f0 msgr2=0x7fb8c414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:28.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/1624967888 >> v2:172.21.15.100:3300/0 conn(0x7fb8c40c37f0 0x7fb8c414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c3fff700 1 -- 172.21.15.105:0/1624967888 >> v1:172.21.15.67:6789/0 conn(0x7fb8c414b410 legacy=0x7fb8c4065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c3fff700 1 -- 172.21.15.105:0/1624967888 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40be060 con 0x7fb8c409ad30 2020-11-20T11:29:28.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c37fe700 1 -- 172.21.15.105:0/1624967888 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383875226 0 0) 0x7fb8c40bde30 con 0x7fb8c414b410 2020-11-20T11:29:28.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/1624967888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c40c3300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb8c4067c70 tx=0x7fb8b8006d90).ready entity=mon.0 client_cookie=d9d1354304be1e48 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:28.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c37fe700 1 -- 172.21.15.105:0/1624967888 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8006030 con 0x7fb8c409ad30 2020-11-20T11:29:28.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c37fe700 1 -- 172.21.15.105:0/1624967888 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8006190 con 0x7fb8c409ad30 2020-11-20T11:29:28.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8c37fe700 1 -- 172.21.15.105:0/1624967888 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8006510 con 0x7fb8c409ad30 2020-11-20T11:29:28.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 -- 172.21.15.105:0/1624967888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 msgr2=0x7fb8c40c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/1624967888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c40c3300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb8c4067c70 tx=0x7fb8b8006d90).stop 2020-11-20T11:29:28.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 -- 172.21.15.105:0/1624967888 shutdown_connections 2020-11-20T11:29:28.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/1624967888 >> v2:172.21.15.100:3300/0 conn(0x7fb8c40c37f0 0x7fb8c414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/1624967888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c40c3300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.920+0000 7fb8cadd3700 1 -- 172.21.15.105:0/1624967888 >> 172.21.15.105:0/1624967888 conn(0x7fb8c40b9890 msgr2=0x7fb8c40b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:28.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.921+0000 7fb8cadd3700 1 -- 172.21.15.105:0/1624967888 shutdown_connections 2020-11-20T11:29:28.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.921+0000 7fb8cadd3700 1 -- 172.21.15.105:0/1624967888 wait complete. 2020-11-20T11:29:28.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 Processor -- start 2020-11-20T11:29:28.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 -- start start 2020-11-20T11:29:28.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 0x7fb8c414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c414b410 0x7fb8c4150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c414eb10 con 0x7fb8c414b410 2020-11-20T11:29:28.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4160a50 con 0x7fb8c40c37f0 2020-11-20T11:29:28.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.922+0000 7fb8cadd3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415fd30 con 0x7fb8c409ad30 2020-11-20T11:29:28.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41384/0 (socket says 172.21.15.105:41384) 2020-11-20T11:29:28.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 -- 172.21.15.105:0/2126756477 learned_addr learned my addr 172.21.15.105:0/2126756477 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:28.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c9370700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c414b410 0x7fb8c4150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 0x7fb8c414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 -- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 msgr2=0x7fb8c414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 0x7fb8c414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 -- 172.21.15.105:0/2126756477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c414b410 msgr2=0x7fb8c4150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:28.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c414b410 0x7fb8c4150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:28.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 -- 172.21.15.105:0/2126756477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c415ffd0 con 0x7fb8c409ad30 2020-11-20T11:29:28.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 0x7fb8c414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:28.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c8b6f700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb8b400c790 tx=0x7fb8b4007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:28.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40072e0 con 0x7fb8c409ad30 2020-11-20T11:29:28.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4007440 con 0x7fb8c409ad30 2020-11-20T11:29:28.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4160270 con 0x7fb8c409ad30 2020-11-20T11:29:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4005840 con 0x7fb8c409ad30 2020-11-20T11:29:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.923+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c41607b0 con 0x7fb8c409ad30 2020-11-20T11:29:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.924+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c4044f60 con 0x7fb8c409ad30 2020-11-20T11:29:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.925+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb8b401a060 con 0x7fb8c409ad30 2020-11-20T11:29:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.925+0000 7fb8c0ff9700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:28.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.925+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7703+0+0 (secure 0 0 0) 0x7fb8b40a1f50 con 0x7fb8c409ad30 2020-11-20T11:29:28.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.925+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:28.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.926+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8c4067c70 tx=0x7fb8b8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:28.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:28.929+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb8b4076c20 con 0x7fb8c409ad30 2020-11-20T11:29:29.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:29.092+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fb8c40c35d0 con 0x7fb8c409ad30 2020-11-20T11:29:30.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.788+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2126756477 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v26) v1 ==== 188+0+0 (secure 0 0 0) 0x7fb8b4018030 con 0x7fb8c409ad30 2020-11-20T11:29:30.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 msgr2=0x7fb89c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8c4067c70 tx=0x7fb8b8015000).stop 2020-11-20T11:29:30.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 msgr2=0x7fb8c40671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb8b400c790 tx=0x7fb8b4007c90).stop 2020-11-20T11:29:30.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 shutdown_connections 2020-11-20T11:29:30.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c414b410 0x7fb8c4150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c409ad30 0x7fb8c40671c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 --2- 172.21.15.105:0/2126756477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40c37f0 0x7fb8c414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.791+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 >> 172.21.15.105:0/2126756477 conn(0x7fb8c40b9890 msgr2=0x7fb8c4146d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:30.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.792+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 shutdown_connections 2020-11-20T11:29:30.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.792+0000 7fb8cadd3700 1 -- 172.21.15.105:0/2126756477 wait complete. 2020-11-20T11:29:30.798 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2020-11-20T11:29:30.811 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T11:29:30.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.943+0000 7f2336ee6700 1 Processor -- start 2020-11-20T11:29:30.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.943+0000 7f2336ee6700 1 -- start start 2020-11-20T11:29:30.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f2336ee6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23300c34c0 0x7f233014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f2336ee6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233009b250 con 0x7f23300bf4d0 2020-11-20T11:29:30.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f2336ee6700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233014f5a0 con 0x7f23300bdd90 2020-11-20T11:29:30.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f2336ee6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233014f840 con 0x7f23300c34c0 2020-11-20T11:29:30.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f232ffff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f23300bdd90 0x7f23300bedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60016/0 (socket says 172.21.15.105:60016) 2020-11-20T11:29:30.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f232ffff700 1 -- 172.21.15.105:0/2413075803 learned_addr learned my addr 172.21.15.105:0/2413075803 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:30.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> v2:172.21.15.67:3300/0 conn(0x7f23300c34c0 0x7f233014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256553842 0 0) 0x7f233014f5a0 con 0x7f23300bdd90 2020-11-20T11:29:30.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.944+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231c003240 con 0x7f23300bdd90 2020-11-20T11:29:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2086450266 0 0) 0x7f231c003240 con 0x7f23300bdd90 2020-11-20T11:29:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 >> v2:172.21.15.67:3300/0 conn(0x7f23300c34c0 msgr2=0x7f233014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 --2- 172.21.15.105:0/2413075803 >> v2:172.21.15.67:3300/0 conn(0x7f23300c34c0 0x7f233014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 >> v1:172.21.15.67:6789/0 conn(0x7f23300bf4d0 legacy=0x7f23300bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233014fae0 con 0x7f23300bdd90 2020-11-20T11:29:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f2324001530 con 0x7f23300bdd90 2020-11-20T11:29:30.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> v2:172.21.15.67:3300/0 conn(0x7f23300c34c0 0x7f233014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:30.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 >> v1:172.21.15.100:6789/0 conn(0x7f23300bdd90 legacy=0x7f23300bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f231c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233014f840 con 0x7f231c0044e0 2020-11-20T11:29:30.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c005300 con 0x7f231c004e50 2020-11-20T11:29:30.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c00bc20 con 0x7f231c003780 2020-11-20T11:29:30.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f231c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232ffff700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.958 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2335483700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.958 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 -- 172.21.15.105:0/2413075803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f231c004e50 msgr2=0x7f231c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:30.958 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.958 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 -- 172.21.15.105:0/2413075803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f231c0044e0 msgr2=0x7f231c004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:30.958 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.959 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 -- 172.21.15.105:0/2413075803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c003240 con 0x7f231c003780 2020-11-20T11:29:30.959 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2335483700 1 -- 172.21.15.105:0/2413075803 reap_dead start 2020-11-20T11:29:30.959 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f2334c82700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f231c003ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f232000be80 tx=0x7f2320006df0).ready entity=mon.2 client_cookie=ef4667ea318a8f36 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:30.959 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000b590 con 0x7f231c003780 2020-11-20T11:29:30.959 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232000ec40 con 0x7f231c003780 2020-11-20T11:29:30.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.945+0000 7f232f7fe700 1 -- 172.21.15.105:0/2413075803 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200123f0 con 0x7f231c003780 2020-11-20T11:29:30.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 -- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 msgr2=0x7f231c003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f231c003ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f232000be80 tx=0x7f2320006df0).stop 2020-11-20T11:29:30.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 -- 172.21.15.105:0/2413075803 shutdown_connections 2020-11-20T11:29:30.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 --2- 172.21.15.105:0/2413075803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f231c003ba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 -- 172.21.15.105:0/2413075803 >> 172.21.15.105:0/2413075803 conn(0x7f23300b9890 msgr2=0x7f23300b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:30.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 -- 172.21.15.105:0/2413075803 shutdown_connections 2020-11-20T11:29:30.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.946+0000 7f2336ee6700 1 -- 172.21.15.105:0/2413075803 wait complete. 2020-11-20T11:29:30.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.947+0000 7f2336ee6700 1 Processor -- start 2020-11-20T11:29:30.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.947+0000 7f2336ee6700 1 -- start start 2020-11-20T11:29:30.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 0x7f233014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233014b8b0 0x7f233014a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233015f110 con 0x7f233008ea60 2020-11-20T11:29:30.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2330154120 con 0x7f233014b8b0 2020-11-20T11:29:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2336ee6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2330154350 con 0x7f231c003780 2020-11-20T11:29:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41408/0 (socket says 172.21.15.105:41408) 2020-11-20T11:29:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 -- 172.21.15.105:0/585777061 learned_addr learned my addr 172.21.15.105:0/585777061 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2335483700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233014b8b0 0x7f233014a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f232ffff700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 0x7f233014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 -- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233014b8b0 msgr2=0x7f233014a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233014b8b0 0x7f233014a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 -- 172.21.15.105:0/585777061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 msgr2=0x7f233014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 0x7f233014b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:30.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 -- 172.21.15.105:0/585777061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23301545f0 con 0x7f231c003780 2020-11-20T11:29:30.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f232ffff700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 0x7f233014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:30.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.948+0000 7f2334c82700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f232000b710 tx=0x7f2320019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:30.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.949+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232001b3f0 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.949+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232001b550 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.949+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232001b8f0 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.949+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2330154890 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.949+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2330154dd0 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.950+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2330044f60 con 0x7f231c003780 2020-11-20T11:29:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.950+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f232002b070 con 0x7f231c003780 2020-11-20T11:29:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.950+0000 7f232cff9700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 0x7f2308082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.951+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f23200a3f10 con 0x7f231c003780 2020-11-20T11:29:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.951+0000 7f232ffff700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 0x7f2308082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.951+0000 7f232ffff700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 0x7f2308082b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2324001e80 tx=0x7f2324009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:30.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:30.954+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2320078a20 con 0x7f231c003780 2020-11-20T11:29:31.120 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.117+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f2330153e60 con 0x7f231c003780 2020-11-20T11:29:31.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.790+0000 7f232cff9700 1 -- 172.21.15.105:0/585777061 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 166+0+0 (secure 0 0 0) 0x7f232007c040 con 0x7f231c003780 2020-11-20T11:29:31.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 msgr2=0x7f2308082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:31.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 0x7f2308082b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2324001e80 tx=0x7f2324009040).stop 2020-11-20T11:29:31.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 msgr2=0x7f233015ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:31.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f232000b710 tx=0x7f2320019000).stop 2020-11-20T11:29:31.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 shutdown_connections 2020-11-20T11:29:31.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233014b8b0 0x7f233014a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2308080660 0x7f2308082b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f231c003780 0x7f233015ec20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 --2- 172.21.15.105:0/585777061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f233008ea60 0x7f233014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.792+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 >> 172.21.15.105:0/585777061 conn(0x7f23300b9890 msgr2=0x7f23300c0330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:31.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.793+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 shutdown_connections 2020-11-20T11:29:31.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.793+0000 7f2336ee6700 1 -- 172.21.15.105:0/585777061 wait complete. 2020-11-20T11:29:31.799 INFO:teuthology.orchestra.run.smithi105.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T11:29:31.810 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T11:29:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.932+0000 7f4728984700 1 Processor -- start 2020-11-20T11:29:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.932+0000 7f4728984700 1 -- start start 2020-11-20T11:29:31.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.932+0000 7f4728984700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4724061ee0 0x7f4724065060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f4728984700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47240667b0 0x7f4724066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f4728984700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472409b1a0 con 0x7f472409ad30 2020-11-20T11:29:31.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f4728984700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4724065640 con 0x7f47240667b0 2020-11-20T11:29:31.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f4728984700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472414d860 con 0x7f4724061ee0 2020-11-20T11:29:31.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4724061ee0 0x7f4724065060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4724061ee0 0x7f4724065060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41414/0 (socket says 172.21.15.105:41414) 2020-11-20T11:29:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 -- 172.21.15.105:0/34163287 learned_addr learned my addr 172.21.15.105:0/34163287 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f4722d9d700 1 --2- 172.21.15.105:0/34163287 >> v2:172.21.15.100:3300/0 conn(0x7f47240667b0 0x7f4724066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 -- 172.21.15.105:0/34163287 >> v2:172.21.15.100:3300/0 conn(0x7f47240667b0 msgr2=0x7f4724066c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 --2- 172.21.15.105:0/34163287 >> v2:172.21.15.100:3300/0 conn(0x7f47240667b0 0x7f4724066c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 -- 172.21.15.105:0/34163287 >> v1:172.21.15.67:6789/0 conn(0x7f472409ad30 legacy=0x7f47240622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 -- 172.21.15.105:0/34163287 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472414db00 con 0x7f4724061ee0 2020-11-20T11:29:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472259c700 1 --2- 172.21.15.105:0/34163287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4724061ee0 0x7f4724065060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4724026ed0 tx=0x7f4714006eb0).ready entity=mon.2 client_cookie=29646bb35a24687f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472159a700 1 -- 172.21.15.105:0/34163287 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714009890 con 0x7f4724061ee0 2020-11-20T11:29:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472159a700 1 -- 172.21.15.105:0/34163287 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140099f0 con 0x7f4724061ee0 2020-11-20T11:29:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.933+0000 7f472159a700 1 -- 172.21.15.105:0/34163287 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714009d70 con 0x7f4724061ee0 2020-11-20T11:29:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 -- 172.21.15.105:0/34163287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4724061ee0 msgr2=0x7f4724065060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 --2- 172.21.15.105:0/34163287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4724061ee0 0x7f4724065060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4724026ed0 tx=0x7f4714006eb0).stop 2020-11-20T11:29:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 -- 172.21.15.105:0/34163287 shutdown_connections 2020-11-20T11:29:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 --2- 172.21.15.105:0/34163287 >> v2:172.21.15.100:3300/0 conn(0x7f47240667b0 0x7f4724066c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 --2- 172.21.15.105:0/34163287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4724061ee0 0x7f4724065060 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 -- 172.21.15.105:0/34163287 >> 172.21.15.105:0/34163287 conn(0x7f47240b9890 msgr2=0x7f47240b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:31.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 -- 172.21.15.105:0/34163287 shutdown_connections 2020-11-20T11:29:31.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.934+0000 7f4728984700 1 -- 172.21.15.105:0/34163287 wait complete. 2020-11-20T11:29:31.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 Processor -- start 2020-11-20T11:29:31.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 -- start start 2020-11-20T11:29:31.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4724061ee0 0x7f47241399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 0x7f47240c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.935+0000 7f4728984700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724161610 con 0x7f4724061ee0 2020-11-20T11:29:31.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4728984700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472415d5f0 con 0x7f472409ad30 2020-11-20T11:29:31.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4728984700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472415d890 con 0x7f47240667b0 2020-11-20T11:29:31.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41422/0 (socket says 172.21.15.105:41422) 2020-11-20T11:29:31.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 -- 172.21.15.105:0/2082341338 learned_addr learned my addr 172.21.15.105:0/2082341338 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:31.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4722d9d700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 0x7f47240c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f472259c700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4724061ee0 0x7f47241399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 -- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 msgr2=0x7f47240c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:31.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 0x7f47240c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 -- 172.21.15.105:0/2082341338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4724061ee0 msgr2=0x7f47241399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:31.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4724061ee0 0x7f47241399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:31.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 -- 172.21.15.105:0/2082341338 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472415db30 con 0x7f47240667b0 2020-11-20T11:29:31.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4722d9d700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 0x7f47240c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:31.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4721d9b700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f47180078a0 tx=0x7f4718007c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:31.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718010770 con 0x7f47240667b0 2020-11-20T11:29:31.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47180108f0 con 0x7f47240667b0 2020-11-20T11:29:31.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472415ddd0 con 0x7f47240667b0 2020-11-20T11:29:31.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718010cb0 con 0x7f47240667b0 2020-11-20T11:29:31.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.936+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4724138370 con 0x7f47240667b0 2020-11-20T11:29:31.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.937+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472415df60 con 0x7f47240667b0 2020-11-20T11:29:31.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.938+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4718021070 con 0x7f47240667b0 2020-11-20T11:29:31.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.938+0000 7f47127fc700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 0x7f46f8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:31.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.938+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f47180a4910 con 0x7f47240667b0 2020-11-20T11:29:31.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.939+0000 7f472259c700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 0x7f46f8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:31.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.939+0000 7f472259c700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 0x7f46f8082af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4714006ef0 tx=0x7f4714015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:31.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:31.942+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4718079420 con 0x7f47240667b0 2020-11-20T11:29:32.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.161+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4724044f60 con 0x7f47240667b0 2020-11-20T11:29:32.172 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.169+0000 7f47127fc700 1 -- 172.21.15.105:0/2082341338 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4718007d50 con 0x7f47240667b0 2020-11-20T11:29:32.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 msgr2=0x7f46f8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 0x7f46f8082af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4714006ef0 tx=0x7f4714015000).stop 2020-11-20T11:29:32.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 msgr2=0x7f47240c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f47180078a0 tx=0x7f4718007c30).stop 2020-11-20T11:29:32.176 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 shutdown_connections 2020-11-20T11:29:32.176 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472409ad30 0x7f47240c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.176 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4724061ee0 0x7f47241399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.176 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f46f8080630 0x7f46f8082af0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.176 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 --2- 172.21.15.105:0/2082341338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47240667b0 0x7f47240c3160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.177 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 >> 172.21.15.105:0/2082341338 conn(0x7f47240b9890 msgr2=0x7f47240c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.177 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 shutdown_connections 2020-11-20T11:29:32.177 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.171+0000 7f4728984700 1 -- 172.21.15.105:0/2082341338 wait complete. 2020-11-20T11:29:32.178 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T11:29:32.188 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:32.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.302+0000 7f2ffceff700 1 Processor -- start 2020-11-20T11:29:32.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.302+0000 7f2ffceff700 1 -- start start 2020-11-20T11:29:32.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.303+0000 7f2ffceff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ff80bdda0 0x7f2ff8062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.303+0000 7f2ffceff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80bfc10 con 0x7f2ff814b390 2020-11-20T11:29:32.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.303+0000 7f2ffceff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff814e6e0 con 0x7f2ff814b770 2020-11-20T11:29:32.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.303+0000 7f2ffceff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff814eec0 con 0x7f2ff80bdda0 2020-11-20T11:29:32.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2ff814b770 0x7f2ff80c05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41032/0 (socket says 172.21.15.105:41032) 2020-11-20T11:29:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 -- 172.21.15.105:0/2535904501 learned_addr learned my addr 172.21.15.105:0/2535904501 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff6d9d700 1 --2- 172.21.15.105:0/2535904501 >> v2:172.21.15.100:3300/0 conn(0x7f2ff80bdda0 0x7f2ff8062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640952094 0 0) 0x7f2ff814e6e0 con 0x7f2ff814b770 2020-11-20T11:29:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fdc003240 con 0x7f2ff814b770 2020-11-20T11:29:32.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1088162631 0 0) 0x7f2fdc003240 con 0x7f2ff814b770 2020-11-20T11:29:32.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 >> v2:172.21.15.100:3300/0 conn(0x7f2ff80bdda0 msgr2=0x7f2ff8062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 --2- 172.21.15.105:0/2535904501 >> v2:172.21.15.100:3300/0 conn(0x7f2ff80bdda0 0x7f2ff8062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 >> v1:172.21.15.67:6789/0 conn(0x7f2ff814b390 legacy=0x7f2ff814df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff814e980 con 0x7f2ff814b770 2020-11-20T11:29:32.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f2fe8001520 con 0x7f2ff814b770 2020-11-20T11:29:32.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 >> v1:172.21.15.105:6789/0 conn(0x7f2ff814b770 legacy=0x7f2ff80c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fdc003730 0x7f2fdc003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2fdc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fdc004e50 0x7f2fdc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff814eec0 con 0x7f2fdc004e50 2020-11-20T11:29:32.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc004220 con 0x7f2fdc003730 2020-11-20T11:29:32.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc00bc20 con 0x7f2fdc0044e0 2020-11-20T11:29:32.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2fdc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff659c700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fdc003730 0x7f2fdc003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff6d9d700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fdc004e50 0x7f2fdc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 -- 172.21.15.105:0/2535904501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fdc003730 msgr2=0x7f2fdc003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fdc003730 0x7f2fdc003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 -- 172.21.15.105:0/2535904501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fdc004e50 msgr2=0x7f2fdc00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fdc004e50 0x7f2fdc00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff6d9d700 1 -- 172.21.15.105:0/2535904501 reap_dead start 2020-11-20T11:29:32.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.304+0000 7f2ff5d9b700 1 -- 172.21.15.105:0/2535904501 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc003240 con 0x7f2fdc0044e0 2020-11-20T11:29:32.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2fdc004960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2fe800c440 tx=0x7f2ff8067d10).ready entity=mon.2 client_cookie=793f54697482279c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80070d0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8007230 con 0x7f2fdc0044e0 2020-11-20T11:29:32.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ff559a700 1 -- 172.21.15.105:0/2535904501 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80055f0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 -- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 msgr2=0x7f2fdc004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2fdc004960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2fe800c440 tx=0x7f2ff8067d10).stop 2020-11-20T11:29:32.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 -- 172.21.15.105:0/2535904501 shutdown_connections 2020-11-20T11:29:32.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2535904501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2fdc004960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 -- 172.21.15.105:0/2535904501 >> 172.21.15.105:0/2535904501 conn(0x7f2ff80b9910 msgr2=0x7f2ff80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 -- 172.21.15.105:0/2535904501 shutdown_connections 2020-11-20T11:29:32.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.305+0000 7f2ffceff700 1 -- 172.21.15.105:0/2535904501 wait complete. 2020-11-20T11:29:32.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.306+0000 7f2ffceff700 1 Processor -- start 2020-11-20T11:29:32.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.306+0000 7f2ffceff700 1 -- start start 2020-11-20T11:29:32.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 0x7f2ff814dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 0x7f2ff815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff814e3c0 con 0x7f2ff814a9e0 2020-11-20T11:29:32.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8149140 con 0x7f2ff80c14c0 2020-11-20T11:29:32.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ffceff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff81493e0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41440/0 (socket says 172.21.15.105:41440) 2020-11-20T11:29:32.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 -- 172.21.15.105:0/2721128067 learned_addr learned my addr 172.21.15.105:0/2721128067 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:32.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff6d9d700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 0x7f2ff815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 0x7f2ff814dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 -- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 msgr2=0x7f2ff815fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 0x7f2ff815fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 -- 172.21.15.105:0/2721128067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 msgr2=0x7f2ff814dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 0x7f2ff814dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff659c700 1 -- 172.21.15.105:0/2721128067 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8149680 con 0x7f2fdc0044e0 2020-11-20T11:29:32.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff6d9d700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 0x7f2ff815fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:32.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.307+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 0x7f2ff814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:32.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2ff659c700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2fec0076d0 tx=0x7f2fec007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec007020 con 0x7f2fdc0044e0 2020-11-20T11:29:32.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec007180 con 0x7f2fdc0044e0 2020-11-20T11:29:32.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff815f6d0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00f9d0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.308+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff8146570 con 0x7f2fdc0044e0 2020-11-20T11:29:32.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.309+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80c02f0 con 0x7f2fdc0044e0 2020-11-20T11:29:32.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.309+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2fec00fd80 con 0x7f2fdc0044e0 2020-11-20T11:29:32.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.310+0000 7f2fe67fc700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 0x7f2fd0082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.310+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2fec0a2a50 con 0x7f2fdc0044e0 2020-11-20T11:29:32.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.310+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 0x7f2fd0082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.310+0000 7f2ff5d9b700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 0x7f2fd0082b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2ff80c1e40 tx=0x7f2fe8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.313+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2fec077460 con 0x7f2fdc0044e0 2020-11-20T11:29:32.481 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.478+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff8044f60 con 0x7f2fdc0044e0 2020-11-20T11:29:32.482 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.479+0000 7f2fe67fc700 1 -- 172.21.15.105:0/2721128067 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f2fec07aa80 con 0x7f2fdc0044e0 2020-11-20T11:29:32.482 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:32.483 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:32.484 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 msgr2=0x7f2fd0082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.484 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 0x7f2fd0082b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2ff80c1e40 tx=0x7f2fe8015000).stop 2020-11-20T11:29:32.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 msgr2=0x7f2ff814a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2fec0076d0 tx=0x7f2fec007b70).stop 2020-11-20T11:29:32.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 shutdown_connections 2020-11-20T11:29:32.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff80c14c0 0x7f2ff815fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2fd0080660 0x7f2fd0082b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fdc0044e0 0x7f2ff814a3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 --2- 172.21.15.105:0/2721128067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff814a9e0 0x7f2ff814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 >> 172.21.15.105:0/2721128067 conn(0x7f2ff80b9910 msgr2=0x7f2ff80c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 shutdown_connections 2020-11-20T11:29:32.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.481+0000 7f2ffceff700 1 -- 172.21.15.105:0/2721128067 wait complete. 2020-11-20T11:29:32.496 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:32.613 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.610+0000 7f61cf6f9700 1 Processor -- start 2020-11-20T11:29:32.614 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.610+0000 7f61cf6f9700 1 -- start start 2020-11-20T11:29:32.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61c80bfd60 0x7f61c80c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61c81518e0 0x7f61c8067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61c8067920 0x7f61c80c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c8061d20 con 0x7f61c81518e0 2020-11-20T11:29:32.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c814d790 con 0x7f61c8067920 2020-11-20T11:29:32.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cf6f9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80be1c0 con 0x7f61c80bfd60 2020-11-20T11:29:32.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61c80bfd60 0x7f61c80c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61c80bfd60 0x7f61c80c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41448/0 (socket says 172.21.15.105:41448) 2020-11-20T11:29:32.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 -- 172.21.15.105:0/3301426496 learned_addr learned my addr 172.21.15.105:0/3301426496 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:32.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61ccc94700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.67:3300/0 conn(0x7f61c81518e0 0x7f61c8067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cdc96700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.100:3300/0 conn(0x7f61c8067920 0x7f61c80c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 -- 172.21.15.105:0/3301426496 >> v2:172.21.15.100:3300/0 conn(0x7f61c8067920 msgr2=0x7f61c80c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.100:3300/0 conn(0x7f61c8067920 0x7f61c80c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 -- 172.21.15.105:0/3301426496 >> v2:172.21.15.67:3300/0 conn(0x7f61c81518e0 msgr2=0x7f61c8067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.67:3300/0 conn(0x7f61c81518e0 0x7f61c8067430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 -- 172.21.15.105:0/3301426496 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80be460 con 0x7f61c80bfd60 2020-11-20T11:29:32.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61cd495700 1 --2- 172.21.15.105:0/3301426496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c80c0140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f61c8064330 tx=0x7f61c0009290).ready entity=mon.2 client_cookie=aa936a8dbe25f18f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.611+0000 7f61b7fff700 1 -- 172.21.15.105:0/3301426496 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000bb80 con 0x7f61c80bfd60 2020-11-20T11:29:32.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61b7fff700 1 -- 172.21.15.105:0/3301426496 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000bce0 con 0x7f61c80bfd60 2020-11-20T11:29:32.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61b7fff700 1 -- 172.21.15.105:0/3301426496 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0011610 con 0x7f61c80bfd60 2020-11-20T11:29:32.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 -- 172.21.15.105:0/3301426496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 msgr2=0x7f61c80c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/3301426496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c80c0140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f61c8064330 tx=0x7f61c0009290).stop 2020-11-20T11:29:32.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 -- 172.21.15.105:0/3301426496 shutdown_connections 2020-11-20T11:29:32.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.100:3300/0 conn(0x7f61c8067920 0x7f61c80c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/3301426496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c80c0140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/3301426496 >> v2:172.21.15.67:3300/0 conn(0x7f61c81518e0 0x7f61c8067430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 -- 172.21.15.105:0/3301426496 >> 172.21.15.105:0/3301426496 conn(0x7f61c80b9910 msgr2=0x7f61c80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 -- 172.21.15.105:0/3301426496 shutdown_connections 2020-11-20T11:29:32.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.612+0000 7f61cf6f9700 1 -- 172.21.15.105:0/3301426496 wait complete. 2020-11-20T11:29:32.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.613+0000 7f61cf6f9700 1 Processor -- start 2020-11-20T11:29:32.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.613+0000 7f61cf6f9700 1 -- start start 2020-11-20T11:29:32.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c8067920 0x7f61c815f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61c81518e0 0x7f61c8150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80bb3b0 con 0x7f61c8067920 2020-11-20T11:29:32.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c814ec00 con 0x7f61c81518e0 2020-11-20T11:29:32.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cf6f9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c814eea0 con 0x7f61c80bfd60 2020-11-20T11:29:32.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41456/0 (socket says 172.21.15.105:41456) 2020-11-20T11:29:32.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 -- 172.21.15.105:0/2032558083 learned_addr learned my addr 172.21.15.105:0/2032558083 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:32.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cd495700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c8067920 0x7f61c815f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61cdc96700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61c81518e0 0x7f61c8150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 -- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61c81518e0 msgr2=0x7f61c8150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61c81518e0 0x7f61c8150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 -- 172.21.15.105:0/2032558083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c8067920 msgr2=0x7f61c815f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c8067920 0x7f61c815f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 -- 172.21.15.105:0/2032558083 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c814f140 con 0x7f61c80bfd60 2020-11-20T11:29:32.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.614+0000 7f61ccc94700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f61b800a7e0 tx=0x7f61b8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.615+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800e5d0 con 0x7f61c80bfd60 2020-11-20T11:29:32.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.615+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800c030 con 0x7f61c80bfd60 2020-11-20T11:29:32.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.615+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c814f3e0 con 0x7f61c80bfd60 2020-11-20T11:29:32.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.615+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800e960 con 0x7f61c80bfd60 2020-11-20T11:29:32.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.615+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c81515f0 con 0x7f61c80bfd60 2020-11-20T11:29:32.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.616+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c814f570 con 0x7f61c80bfd60 2020-11-20T11:29:32.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.616+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f61b8019030 con 0x7f61c80bfd60 2020-11-20T11:29:32.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.617+0000 7f61b57fa700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 0x7f61a0082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.617+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f61b80a21e0 con 0x7f61c80bfd60 2020-11-20T11:29:32.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.617+0000 7f61cd495700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 0x7f61a0082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.617+0000 7f61cd495700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 0x7f61a0082b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f61c0009fd0 tx=0x7f61c0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.620+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f61b8076bf0 con 0x7f61c80bfd60 2020-11-20T11:29:32.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.783+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61c8044f60 con 0x7f61c80bfd60 2020-11-20T11:29:32.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.784+0000 7f61b57fa700 1 -- 172.21.15.105:0/2032558083 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f61b807a210 con 0x7f61c80bfd60 2020-11-20T11:29:32.789 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:32.789 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:32.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.785+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 msgr2=0x7f61a0082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.785+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 0x7f61a0082b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f61c0009fd0 tx=0x7f61c0016000).stop 2020-11-20T11:29:32.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.785+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 msgr2=0x7f61c814f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.785+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f61b800a7e0 tx=0x7f61b8008040).stop 2020-11-20T11:29:32.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 shutdown_connections 2020-11-20T11:29:32.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61c81518e0 0x7f61c8150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c8067920 0x7f61c815f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f61a0080660 0x7f61a0082b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 --2- 172.21.15.105:0/2032558083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c80bfd60 0x7f61c814f880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 >> 172.21.15.105:0/2032558083 conn(0x7f61c80b9910 msgr2=0x7f61c8067160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 shutdown_connections 2020-11-20T11:29:32.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.786+0000 7f61cf6f9700 1 -- 172.21.15.105:0/2032558083 wait complete. 2020-11-20T11:29:32.801 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T11:29:32.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.923+0000 7f3a71ef2700 1 Processor -- start 2020-11-20T11:29:32.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.923+0000 7f3a71ef2700 1 -- start start 2020-11-20T11:29:32.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.924+0000 7f3a71ef2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a6c14b410 0x7f3a6c065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.924+0000 7f3a71ef2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a6c09ad30 0x7f3a6c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.924+0000 7f3a71ef2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0bde30 con 0x7f3a6c0c3300 2020-11-20T11:29:32.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.924+0000 7f3a71ef2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c0beae0 con 0x7f3a6c14b410 2020-11-20T11:29:32.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.924+0000 7f3a71ef2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c14de60 con 0x7f3a6c09ad30 2020-11-20T11:29:32.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a6c09ad30 0x7f3a6c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a6c09ad30 0x7f3a6c065a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59592/0 (socket says 172.21.15.105:59592) 2020-11-20T11:29:32.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 -- 172.21.15.105:0/744547260 learned_addr learned my addr 172.21.15.105:0/744547260 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:32.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6b7fe700 1 --2- 172.21.15.105:0/744547260 >> v2:172.21.15.67:3300/0 conn(0x7f3a6c14b410 0x7f3a6c065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 -- 172.21.15.105:0/744547260 >> v2:172.21.15.67:3300/0 conn(0x7f3a6c14b410 msgr2=0x7f3a6c065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:32.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 --2- 172.21.15.105:0/744547260 >> v2:172.21.15.67:3300/0 conn(0x7f3a6c14b410 0x7f3a6c065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 -- 172.21.15.105:0/744547260 >> v1:172.21.15.67:6789/0 conn(0x7f3a6c0c3300 legacy=0x7f3a6c0c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 -- 172.21.15.105:0/744547260 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0be060 con 0x7f3a6c09ad30 2020-11-20T11:29:32.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6affd700 1 --2- 172.21.15.105:0/744547260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c065a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3a6c0bd620 tx=0x7f3a60006e50).ready entity=mon.1 client_cookie=345dc957a124b2ce server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6a7fc700 1 -- 172.21.15.105:0/744547260 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60006030 con 0x7f3a6c09ad30 2020-11-20T11:29:32.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6a7fc700 1 -- 172.21.15.105:0/744547260 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60006190 con 0x7f3a6c09ad30 2020-11-20T11:29:32.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.925+0000 7f3a6a7fc700 1 -- 172.21.15.105:0/744547260 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60006510 con 0x7f3a6c09ad30 2020-11-20T11:29:32.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 -- 172.21.15.105:0/744547260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c09ad30 msgr2=0x7f3a6c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/744547260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c065a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3a6c0bd620 tx=0x7f3a60006e50).stop 2020-11-20T11:29:32.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 -- 172.21.15.105:0/744547260 shutdown_connections 2020-11-20T11:29:32.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/744547260 >> v2:172.21.15.67:3300/0 conn(0x7f3a6c14b410 0x7f3a6c065570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/744547260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c065a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 -- 172.21.15.105:0/744547260 >> 172.21.15.105:0/744547260 conn(0x7f3a6c0b9890 msgr2=0x7f3a6c0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:32.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 -- 172.21.15.105:0/744547260 shutdown_connections 2020-11-20T11:29:32.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.926+0000 7f3a71ef2700 1 -- 172.21.15.105:0/744547260 wait complete. 2020-11-20T11:29:32.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.927+0000 7f3a71ef2700 1 Processor -- start 2020-11-20T11:29:32.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.927+0000 7f3a71ef2700 1 -- start start 2020-11-20T11:29:32.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c0c3300 0x7f3a6c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 0x7f3a6c14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c15f8f0 con 0x7f3a6c0c3300 2020-11-20T11:29:32.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c151b90 con 0x7f3a6c14b410 2020-11-20T11:29:32.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c162000 con 0x7f3a6c09ad30 2020-11-20T11:29:32.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41466/0 (socket says 172.21.15.105:41466) 2020-11-20T11:29:32.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 -- 172.21.15.105:0/3657711550 learned_addr learned my addr 172.21.15.105:0/3657711550 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:32.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6affd700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c0c3300 0x7f3a6c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6bfff700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 0x7f3a6c14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 -- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 msgr2=0x7f3a6c14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 0x7f3a6c14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 -- 172.21.15.105:0/3657711550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c0c3300 msgr2=0x7f3a6c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:32.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c0c3300 0x7f3a6c15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:32.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 -- 172.21.15.105:0/3657711550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c1622a0 con 0x7f3a6c09ad30 2020-11-20T11:29:32.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6bfff700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 0x7f3a6c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:32.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a6b7fe700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3a5c00ec00 tx=0x7f3a5c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00b8d0 con 0x7f3a6c09ad30 2020-11-20T11:29:32.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00ba30 con 0x7f3a6c09ad30 2020-11-20T11:29:32.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c162540 con 0x7f3a6c09ad30 2020-11-20T11:29:32.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00bdb0 con 0x7f3a6c09ad30 2020-11-20T11:29:32.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.928+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c162c80 con 0x7f3a6c09ad30 2020-11-20T11:29:32.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.929+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c154420 con 0x7f3a6c09ad30 2020-11-20T11:29:32.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.931+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3a5c012600 con 0x7f3a6c09ad30 2020-11-20T11:29:32.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.931+0000 7f3a4b7fe700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 0x7f3a44082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:32.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.931+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3a5c0a37d0 con 0x7f3a6c09ad30 2020-11-20T11:29:32.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.932+0000 7f3a6affd700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 0x7f3a44082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:32.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.932+0000 7f3a6affd700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 0x7f3a44082b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3a6c0bd620 tx=0x7f3a60015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:32.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:32.934+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3a5c078180 con 0x7f3a6c09ad30 2020-11-20T11:29:33.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.155+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3a6c068690 con 0x7f3a6c09ad30 2020-11-20T11:29:33.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.808+0000 7f3a4b7fe700 1 -- 172.21.15.105:0/3657711550 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3a5c019310 con 0x7f3a6c09ad30 2020-11-20T11:29:33.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 msgr2=0x7f3a44082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 0x7f3a44082b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3a6c0bd620 tx=0x7f3a60015000).stop 2020-11-20T11:29:33.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 msgr2=0x7f3a6c1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3a5c00ec00 tx=0x7f3a5c006df0).stop 2020-11-20T11:29:33.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 shutdown_connections 2020-11-20T11:29:33.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a6c14b410 0x7f3a6c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3a44080660 0x7f3a44082b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c09ad30 0x7f3a6c1514d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 --2- 172.21.15.105:0/3657711550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c0c3300 0x7f3a6c15f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 >> 172.21.15.105:0/3657711550 conn(0x7f3a6c0b9890 msgr2=0x7f3a6c0c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:33.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 shutdown_connections 2020-11-20T11:29:33.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.810+0000 7f3a71ef2700 1 -- 172.21.15.105:0/3657711550 wait complete. 2020-11-20T11:29:33.826 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T11:29:33.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.962+0000 7f3166417700 1 Processor -- start 2020-11-20T11:29:33.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.962+0000 7f3166417700 1 -- start start 2020-11-20T11:29:33.971 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f3166417700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31600c34c0 0x7f316014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.972 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f3166417700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31600bdd90 0x7f31600c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.972 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f3166417700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316009b250 con 0x7f3160152f30 2020-11-20T11:29:33.972 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f3166417700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316014f5a0 con 0x7f31600c34c0 2020-11-20T11:29:33.973 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f3166417700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316014f840 con 0x7f31600bdd90 2020-11-20T11:29:33.973 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f31649b4700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3160152f30 0x7f31600bedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41078/0 (socket says 172.21.15.105:41078) 2020-11-20T11:29:33.973 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f31649b4700 1 -- 172.21.15.105:0/330538435 learned_addr learned my addr 172.21.15.105:0/330538435 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:33.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 --2- 172.21.15.105:0/330538435 >> v2:172.21.15.100:3300/0 conn(0x7f31600bdd90 0x7f31600c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315ffff700 1 --2- 172.21.15.105:0/330538435 >> v2:172.21.15.67:3300/0 conn(0x7f31600c34c0 0x7f316014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315effd700 1 -- 172.21.15.105:0/330538435 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350156211 0 0) 0x7f316009b250 con 0x7f3160152f30 2020-11-20T11:29:33.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315effd700 1 -- 172.21.15.105:0/330538435 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f314c003240 con 0x7f3160152f30 2020-11-20T11:29:33.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 -- 172.21.15.105:0/330538435 >> v2:172.21.15.67:3300/0 conn(0x7f31600c34c0 msgr2=0x7f316014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:33.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 --2- 172.21.15.105:0/330538435 >> v2:172.21.15.67:3300/0 conn(0x7f31600c34c0 0x7f316014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 -- 172.21.15.105:0/330538435 >> v1:172.21.15.105:6789/0 conn(0x7f3160152f30 legacy=0x7f31600bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 -- 172.21.15.105:0/330538435 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316014fae0 con 0x7f31600bdd90 2020-11-20T11:29:33.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315f7fe700 1 --2- 172.21.15.105:0/330538435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f31600c38a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f315400b990 tx=0x7f3154006d90).ready entity=mon.1 client_cookie=b50cdc58ea7c03a1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:33.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315effd700 1 -- 172.21.15.105:0/330538435 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154006030 con 0x7f31600bdd90 2020-11-20T11:29:33.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315effd700 1 -- 172.21.15.105:0/330538435 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154006190 con 0x7f31600bdd90 2020-11-20T11:29:33.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.963+0000 7f315effd700 1 -- 172.21.15.105:0/330538435 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154006510 con 0x7f31600bdd90 2020-11-20T11:29:33.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 -- 172.21.15.105:0/330538435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 msgr2=0x7f31600c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 --2- 172.21.15.105:0/330538435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f31600c38a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f315400b990 tx=0x7f3154006d90).stop 2020-11-20T11:29:33.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 -- 172.21.15.105:0/330538435 shutdown_connections 2020-11-20T11:29:33.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 --2- 172.21.15.105:0/330538435 >> v2:172.21.15.67:3300/0 conn(0x7f31600c34c0 0x7f316014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 --2- 172.21.15.105:0/330538435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f31600c38a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 -- 172.21.15.105:0/330538435 >> 172.21.15.105:0/330538435 conn(0x7f31600b9890 msgr2=0x7f31600b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:33.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 -- 172.21.15.105:0/330538435 shutdown_connections 2020-11-20T11:29:33.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.964+0000 7f3166417700 1 -- 172.21.15.105:0/330538435 wait complete. 2020-11-20T11:29:33.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.965+0000 7f3166417700 1 Processor -- start 2020-11-20T11:29:33.980 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.965+0000 7f3166417700 1 -- start start 2020-11-20T11:29:33.980 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f3160161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3160152f30 0x7f3160149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316015e3f0 con 0x7f3160152f30 2020-11-20T11:29:33.982 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316015e690 con 0x7f31600bdd90 2020-11-20T11:29:33.982 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f3166417700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316015e930 con 0x7f31600c34c0 2020-11-20T11:29:33.982 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.983 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41480/0 (socket says 172.21.15.105:41480) 2020-11-20T11:29:33.983 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 -- 172.21.15.105:0/305769719 learned_addr learned my addr 172.21.15.105:0/305769719 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:33.983 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315ffff700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f3160161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.983 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f31649b4700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3160152f30 0x7f3160149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.984 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 -- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 msgr2=0x7f3160161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.984 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f3160161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.984 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 -- 172.21.15.105:0/305769719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3160152f30 msgr2=0x7f3160149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:33.985 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3160152f30 0x7f3160149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:33.985 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 -- 172.21.15.105:0/305769719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316015ebd0 con 0x7f31600c34c0 2020-11-20T11:29:33.985 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315ffff700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f3160161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:33.985 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.966+0000 7f315f7fe700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3154006dd0 tx=0x7f3154015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:33.986 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.967+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540098e0 con 0x7f31600c34c0 2020-11-20T11:29:33.986 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.967+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154009a40 con 0x7f31600c34c0 2020-11-20T11:29:33.986 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.967+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160153a10 con 0x7f31600c34c0 2020-11-20T11:29:33.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.967+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154009dc0 con 0x7f31600c34c0 2020-11-20T11:29:33.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.967+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3160149930 con 0x7f31600c34c0 2020-11-20T11:29:33.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.968+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3160044f60 con 0x7f31600c34c0 2020-11-20T11:29:33.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.968+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3154017030 con 0x7f31600c34c0 2020-11-20T11:29:33.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.969+0000 7f3147fff700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 0x7f313c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:33.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.969+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f31540a38f0 con 0x7f31600c34c0 2020-11-20T11:29:33.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.969+0000 7f315ffff700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 0x7f313c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:33.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.969+0000 7f315ffff700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 0x7f313c082af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3150006fd0 tx=0x7f3150006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:33.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:33.972+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3154078300 con 0x7f31600c34c0 2020-11-20T11:29:34.194 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.191+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f316015ed60 con 0x7f31600c34c0 2020-11-20T11:29:34.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.810+0000 7f3147fff700 1 -- 172.21.15.105:0/305769719 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) v1 ==== 115+0+0 (secure 0 0 0) 0x7f3154022020 con 0x7f31600c34c0 2020-11-20T11:29:34.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 msgr2=0x7f313c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 0x7f313c082af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3150006fd0 tx=0x7f3150006df0).stop 2020-11-20T11:29:34.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 msgr2=0x7f3160156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3154006dd0 tx=0x7f3154015000).stop 2020-11-20T11:29:34.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 shutdown_connections 2020-11-20T11:29:34.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3160152f30 0x7f3160149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31600bdd90 0x7f3160161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f313c080630 0x7f313c082af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 --2- 172.21.15.105:0/305769719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31600c34c0 0x7f3160156090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 >> 172.21.15.105:0/305769719 conn(0x7f31600b9890 msgr2=0x7f31600c12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:34.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 shutdown_connections 2020-11-20T11:29:34.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.812+0000 7f3166417700 1 -- 172.21.15.105:0/305769719 wait complete. 2020-11-20T11:29:34.829 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:29:34.949 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.946+0000 7fa629628700 1 Processor -- start 2020-11-20T11:29:34.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.946+0000 7fa629628700 1 -- start start 2020-11-20T11:29:34.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa629628700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa62414b390 0x7fa62414df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa629628700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa62414b770 0x7fa6240c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa629628700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240bfc10 con 0x7fa6240c0aa0 2020-11-20T11:29:34.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa629628700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62414eec0 con 0x7fa62414b390 2020-11-20T11:29:34.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa629628700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62414e6e0 con 0x7fa62414b770 2020-11-20T11:29:34.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6227fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa62414b770 0x7fa6240c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6237fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa6240c0aa0 0x7fa624062780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41090/0 (socket says 172.21.15.105:41090) 2020-11-20T11:29:34.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6237fe700 1 -- 172.21.15.105:0/2351267523 learned_addr learned my addr 172.21.15.105:0/2351267523 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:34.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa622ffd700 1 --2- 172.21.15.105:0/2351267523 >> v2:172.21.15.67:3300/0 conn(0x7fa62414b390 0x7fa62414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6227fc700 1 -- 172.21.15.105:0/2351267523 >> v2:172.21.15.67:3300/0 conn(0x7fa62414b390 msgr2=0x7fa62414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:34.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6227fc700 1 --2- 172.21.15.105:0/2351267523 >> v2:172.21.15.67:3300/0 conn(0x7fa62414b390 0x7fa62414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6227fc700 1 -- 172.21.15.105:0/2351267523 >> v1:172.21.15.105:6789/0 conn(0x7fa6240c0aa0 legacy=0x7fa624062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa621ffb700 1 -- 172.21.15.105:0/2351267523 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293791635 0 0) 0x7fa6240bfc10 con 0x7fa6240c0aa0 2020-11-20T11:29:34.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.947+0000 7fa6227fc700 1 -- 172.21.15.105:0/2351267523 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62414e980 con 0x7fa62414b770 2020-11-20T11:29:34.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa6227fc700 1 --2- 172.21.15.105:0/2351267523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b770 0x7fa6240c05b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa6240648d0 tx=0x7fa614006df0).ready entity=mon.2 client_cookie=f8585f0f823439db server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:34.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa621ffb700 1 -- 172.21.15.105:0/2351267523 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140097b0 con 0x7fa62414b770 2020-11-20T11:29:34.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa621ffb700 1 -- 172.21.15.105:0/2351267523 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614009910 con 0x7fa62414b770 2020-11-20T11:29:34.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa621ffb700 1 -- 172.21.15.105:0/2351267523 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614009c90 con 0x7fa62414b770 2020-11-20T11:29:34.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 -- 172.21.15.105:0/2351267523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b770 msgr2=0x7fa6240c05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 --2- 172.21.15.105:0/2351267523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b770 0x7fa6240c05b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa6240648d0 tx=0x7fa614006df0).stop 2020-11-20T11:29:34.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 -- 172.21.15.105:0/2351267523 shutdown_connections 2020-11-20T11:29:34.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 --2- 172.21.15.105:0/2351267523 >> v2:172.21.15.67:3300/0 conn(0x7fa62414b390 0x7fa62414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 --2- 172.21.15.105:0/2351267523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b770 0x7fa6240c05b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 -- 172.21.15.105:0/2351267523 >> 172.21.15.105:0/2351267523 conn(0x7fa6240b9910 msgr2=0x7fa6240b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:34.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 -- 172.21.15.105:0/2351267523 shutdown_connections 2020-11-20T11:29:34.957 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.948+0000 7fa629628700 1 -- 172.21.15.105:0/2351267523 wait complete. 2020-11-20T11:29:34.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.949+0000 7fa629628700 1 Processor -- start 2020-11-20T11:29:34.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.949+0000 7fa629628700 1 -- start start 2020-11-20T11:29:34.960 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 0x7fa62414a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 0x7fa6240c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa6227fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 0x7fa6240c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa622ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 0x7fa62414a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 0x7fa6241400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.961 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa622ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 0x7fa62414a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:44788/0 (socket says 172.21.15.105:44788) 2020-11-20T11:29:34.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa622ffd700 1 -- 172.21.15.105:0/2562909086 learned_addr learned my addr 172.21.15.105:0/2562909086 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:34.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62414ab00 con 0x7fa6240c0aa0 2020-11-20T11:29:34.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c2500 con 0x7fa62414b770 2020-11-20T11:29:34.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c27a0 con 0x7fa62414b390 2020-11-20T11:29:34.962 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.950+0000 7fa6237fe700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 0x7fa6241400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 -- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 msgr2=0x7fa6241400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 0x7fa6241400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 -- 172.21.15.105:0/2562909086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 msgr2=0x7fa62414a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:34.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 0x7fa62414a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:34.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624148e00 con 0x7fa62414b390 2020-11-20T11:29:34.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6237fe700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 0x7fa6241400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:34.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa6227fc700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 0x7fa6240c2c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa614012000 tx=0x7fa614015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:34.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614011d50 con 0x7fa62414b390 2020-11-20T11:29:34.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61401e460 con 0x7fa62414b390 2020-11-20T11:29:34.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6241490a0 con 0x7fa62414b390 2020-11-20T11:29:34.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61401e7e0 con 0x7fa62414b390 2020-11-20T11:29:34.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.951+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6240c1e80 con 0x7fa62414b390 2020-11-20T11:29:34.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.952+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa624148c40 con 0x7fa62414b390 2020-11-20T11:29:34.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.953+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa614025030 con 0x7fa62414b390 2020-11-20T11:29:34.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.953+0000 7fa60affd700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 0x7fa600082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:34.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.953+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa6140a42d0 con 0x7fa62414b390 2020-11-20T11:29:34.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.953+0000 7fa622ffd700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 0x7fa600082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:34.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.954+0000 7fa622ffd700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 0x7fa600082af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa618006a90 tx=0x7fa618006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:34.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:34.957+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa614078ce0 con 0x7fa62414b390 2020-11-20T11:29:35.178 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.175+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa624149230 con 0x7fa62414b390 2020-11-20T11:29:35.179 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.175+0000 7fa60affd700 1 -- 172.21.15.105:0/2562909086 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7fa614023030 con 0x7fa62414b390 2020-11-20T11:29:35.179 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:35.180 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.100:6835/2752212696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2752212696},{"type":"v1","addr":"172.21.15.100:6835","nonce":2752212696}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4295,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2514469097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2514469097},{"type":"v1","addr":"172.21.15.105:6833","nonce":2514469097}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:29:32.164149+0000","modified":"2020-11-20T11:29:34.808094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/151091778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":151091778},{"type":"v1","addr":"172.21.15.67:6833","nonce":151091778}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:29:35.181 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 msgr2=0x7fa600082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.181 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 0x7fa600082af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa618006a90 tx=0x7fa618006df0).stop 2020-11-20T11:29:35.181 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 msgr2=0x7fa6240c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.182 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 0x7fa6240c2c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa614012000 tx=0x7fa614015000).stop 2020-11-20T11:29:35.182 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 shutdown_connections 2020-11-20T11:29:35.182 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa62414b770 0x7fa6241400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.182 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6240c0aa0 0x7fa62414a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.183 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa600080630 0x7fa600082af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.183 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 --2- 172.21.15.105:0/2562909086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62414b390 0x7fa6240c2c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.183 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 >> 172.21.15.105:0/2562909086 conn(0x7fa6240b9910 msgr2=0x7fa624141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.183 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 shutdown_connections 2020-11-20T11:29:35.183 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.177+0000 7fa629628700 1 -- 172.21.15.105:0/2562909086 wait complete. 2020-11-20T11:29:35.184 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 7 2020-11-20T11:29:35.192 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:35.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.306+0000 7fce76e1e700 1 Processor -- start 2020-11-20T11:29:35.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.306+0000 7fce76e1e700 1 -- start start 2020-11-20T11:29:35.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.307+0000 7fce76e1e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce70150140 con 0x7fce7014fce0 2020-11-20T11:29:35.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.307+0000 7fce76e1e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce70152880 con 0x7fce700c3bc0 2020-11-20T11:29:35.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.307+0000 7fce76e1e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce70152b20 con 0x7fce700c37e0 2020-11-20T11:29:35.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.307+0000 7fce74bba700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fce700c37e0 0x7fce700bfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41104/0 (socket says 172.21.15.105:41104) 2020-11-20T11:29:35.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.307+0000 7fce74bba700 1 -- 172.21.15.105:0/766174120 learned_addr learned my addr 172.21.15.105:0/766174120 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:35.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591897502 0 0) 0x7fce70152b20 con 0x7fce700c37e0 2020-11-20T11:29:35.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce5c003240 con 0x7fce700c37e0 2020-11-20T11:29:35.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006193328 0 0) 0x7fce70150140 con 0x7fce7014fce0 2020-11-20T11:29:35.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce70152b20 con 0x7fce7014fce0 2020-11-20T11:29:35.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2332557257 0 0) 0x7fce5c003240 con 0x7fce700c37e0 2020-11-20T11:29:35.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 >> v1:172.21.15.100:6789/0 conn(0x7fce700c3bc0 legacy=0x7fce7014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 >> v1:172.21.15.67:6789/0 conn(0x7fce7014fce0 legacy=0x7fce70159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70152dc0 con 0x7fce700c37e0 2020-11-20T11:29:35.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fce600014e0 con 0x7fce700c37e0 2020-11-20T11:29:35.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 >> v1:172.21.15.105:6789/0 conn(0x7fce700c37e0 legacy=0x7fce700bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c0038c0 0x7fce5c003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce5c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce5c004e50 0x7fce5c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c005380 con 0x7fce5c004e50 2020-11-20T11:29:35.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00bc20 con 0x7fce5c0038c0 2020-11-20T11:29:35.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00bdb0 con 0x7fce5c0044e0 2020-11-20T11:29:35.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce5c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce74bba700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c0038c0 0x7fce5c003ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce753bb700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce5c004e50 0x7fce5c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 -- 172.21.15.105:0/766174120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c0038c0 msgr2=0x7fce5c003ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:35.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c0038c0 0x7fce5c003ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 -- 172.21.15.105:0/766174120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce5c004e50 msgr2=0x7fce5c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:35.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce5c004e50 0x7fce5c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 -- 172.21.15.105:0/766174120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c003240 con 0x7fce5c0044e0 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce753bb700 1 -- 172.21.15.105:0/766174120 reap_dead start 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.308+0000 7fce6ffff700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce5c004960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fce64001a30 tx=0x7fce64007b90).ready entity=mon.2 client_cookie=e1344aa4db537a30 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64007020 con 0x7fce5c0044e0 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64007180 con 0x7fce5c0044e0 2020-11-20T11:29:35.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce6f7fe700 1 -- 172.21.15.105:0/766174120 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400c7f0 con 0x7fce5c0044e0 2020-11-20T11:29:35.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 -- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 msgr2=0x7fce5c004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce5c004960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fce64001a30 tx=0x7fce64007b90).stop 2020-11-20T11:29:35.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 -- 172.21.15.105:0/766174120 shutdown_connections 2020-11-20T11:29:35.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 --2- 172.21.15.105:0/766174120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce5c004960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 -- 172.21.15.105:0/766174120 >> 172.21.15.105:0/766174120 conn(0x7fce700b9910 msgr2=0x7fce700b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 -- 172.21.15.105:0/766174120 shutdown_connections 2020-11-20T11:29:35.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.309+0000 7fce76e1e700 1 -- 172.21.15.105:0/766174120 wait complete. 2020-11-20T11:29:35.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.310+0000 7fce76e1e700 1 Processor -- start 2020-11-20T11:29:35.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.310+0000 7fce76e1e700 1 -- start start 2020-11-20T11:29:35.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce70151a30 0x7fce70155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce70155af0 0x7fce70150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce70163d50 con 0x7fce70155af0 2020-11-20T11:29:35.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce70163ff0 con 0x7fce70151a30 2020-11-20T11:29:35.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce76e1e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce70164290 con 0x7fce5c0044e0 2020-11-20T11:29:35.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41510/0 (socket says 172.21.15.105:41510) 2020-11-20T11:29:35.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 -- 172.21.15.105:0/2146728069 learned_addr learned my addr 172.21.15.105:0/2146728069 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:35.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce6ffff700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce70151a30 0x7fce70155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce753bb700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce70155af0 0x7fce70150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 -- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce70151a30 msgr2=0x7fce70155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce70151a30 0x7fce70155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 -- 172.21.15.105:0/2146728069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce70155af0 msgr2=0x7fce70150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce70155af0 0x7fce70150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.311+0000 7fce74bba700 1 -- 172.21.15.105:0/2146728069 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70164530 con 0x7fce5c0044e0 2020-11-20T11:29:35.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce74bba700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fce60001610 tx=0x7fce70152cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000f960 con 0x7fce5c0044e0 2020-11-20T11:29:35.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000fac0 con 0x7fce5c0044e0 2020-11-20T11:29:35.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000fe60 con 0x7fce5c0044e0 2020-11-20T11:29:35.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce701647d0 con 0x7fce5c0044e0 2020-11-20T11:29:35.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.312+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7014aa90 con 0x7fce5c0044e0 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.313+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce70044f60 con 0x7fce5c0044e0 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.313+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fce600010d0 con 0x7fce5c0044e0 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.314+0000 7fce6cff9700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 0x7fce48082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.314+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fce600a20d0 con 0x7fce5c0044e0 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.314+0000 7fce6ffff700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 0x7fce48082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.314+0000 7fce6ffff700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 0x7fce48082b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fce64001e40 tx=0x7fce64015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.329 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.317+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fce60076ae0 con 0x7fce5c0044e0 2020-11-20T11:29:35.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.481+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce700c4280 con 0x7fce5c0044e0 2020-11-20T11:29:35.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.482+0000 7fce6cff9700 1 -- 172.21.15.105:0/2146728069 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fce60019020 con 0x7fce5c0044e0 2020-11-20T11:29:35.486 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:35.486 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:35.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 msgr2=0x7fce48082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 0x7fce48082b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fce64001e40 tx=0x7fce64015000).stop 2020-11-20T11:29:35.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 msgr2=0x7fce7014a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fce60001610 tx=0x7fce70152cb0).stop 2020-11-20T11:29:35.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 shutdown_connections 2020-11-20T11:29:35.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce70155af0 0x7fce70150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.489 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fce48080660 0x7fce48082b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.489 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce5c0044e0 0x7fce7014a5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.489 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 --2- 172.21.15.105:0/2146728069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce70151a30 0x7fce70155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.489 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 >> 172.21.15.105:0/2146728069 conn(0x7fce700b9910 msgr2=0x7fce7014efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.489 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 shutdown_connections 2020-11-20T11:29:35.490 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.484+0000 7fce76e1e700 1 -- 172.21.15.105:0/2146728069 wait complete. 2020-11-20T11:29:35.499 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:35.499 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T11:29:35.615 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.612+0000 7f5d90025700 1 Processor -- start 2020-11-20T11:29:35.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.612+0000 7f5d90025700 1 -- start start 2020-11-20T11:29:35.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d90025700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d881518e0 0x7f5d880c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d90025700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d88061d20 con 0x7f5d880bfd60 2020-11-20T11:29:35.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d90025700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8814d790 con 0x7f5d8814dbc0 2020-11-20T11:29:35.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d90025700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880be1c0 con 0x7f5d881518e0 2020-11-20T11:29:35.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d8d5c0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d881518e0 0x7f5d880c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d8e5c2700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5d8814dbc0 0x7f5d8814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41122/0 (socket says 172.21.15.105:41122) 2020-11-20T11:29:35.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.613+0000 7f5d8e5c2700 1 -- 172.21.15.105:0/2613851215 learned_addr learned my addr 172.21.15.105:0/2613851215 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:35.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8d5c0700 1 -- 172.21.15.105:0/2613851215 >> v1:172.21.15.105:6789/0 conn(0x7f5d8814dbc0 legacy=0x7f5d8814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8d5c0700 1 -- 172.21.15.105:0/2613851215 >> v1:172.21.15.100:6789/0 conn(0x7f5d880bfd60 legacy=0x7f5d88067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8d5c0700 1 -- 172.21.15.105:0/2613851215 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880be460 con 0x7f5d881518e0 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8d5c0700 1 --2- 172.21.15.105:0/2613851215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d881518e0 0x7f5d880c0140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5d8400b9a0 tx=0x7f5d84006df0).ready entity=mon.2 client_cookie=47970817facdeef8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8cdbf700 1 -- 172.21.15.105:0/2613851215 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840097b0 con 0x7f5d881518e0 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8cdbf700 1 -- 172.21.15.105:0/2613851215 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84009910 con 0x7f5d881518e0 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d8cdbf700 1 -- 172.21.15.105:0/2613851215 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84009c90 con 0x7f5d881518e0 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 -- 172.21.15.105:0/2613851215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d881518e0 msgr2=0x7f5d880c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 --2- 172.21.15.105:0/2613851215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d881518e0 0x7f5d880c0140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5d8400b9a0 tx=0x7f5d84006df0).stop 2020-11-20T11:29:35.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 -- 172.21.15.105:0/2613851215 shutdown_connections 2020-11-20T11:29:35.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 --2- 172.21.15.105:0/2613851215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d881518e0 0x7f5d880c0140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 -- 172.21.15.105:0/2613851215 >> 172.21.15.105:0/2613851215 conn(0x7f5d880b9910 msgr2=0x7f5d880b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 -- 172.21.15.105:0/2613851215 shutdown_connections 2020-11-20T11:29:35.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.614+0000 7f5d90025700 1 -- 172.21.15.105:0/2613851215 wait complete. 2020-11-20T11:29:35.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.615+0000 7f5d90025700 1 Processor -- start 2020-11-20T11:29:35.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.615+0000 7f5d90025700 1 -- start start 2020-11-20T11:29:35.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d8814dbc0 0x7f5d881423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 0x7f5d881428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8813db90 con 0x7f5d8814dbc0 2020-11-20T11:29:35.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8813de30 con 0x7f5d881518e0 2020-11-20T11:29:35.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d90025700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8813e0d0 con 0x7f5d880bfd60 2020-11-20T11:29:35.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d8ddc1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d8ddc1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41522/0 (socket says 172.21.15.105:41522) 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d8ddc1700 1 -- 172.21.15.105:0/2460746184 learned_addr learned my addr 172.21.15.105:0/2460746184 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d8e5c2700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 0x7f5d881428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.616+0000 7f5d8d5c0700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d8814dbc0 0x7f5d881423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 -- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 msgr2=0x7f5d881428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 0x7f5d881428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 -- 172.21.15.105:0/2460746184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d8814dbc0 msgr2=0x7f5d881423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d8814dbc0 0x7f5d881423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 -- 172.21.15.105:0/2460746184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8813e370 con 0x7f5d880bfd60 2020-11-20T11:29:35.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8e5c2700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 0x7f5d881428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:35.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d8ddc1700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5d78001e50 tx=0x7f5d78007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78011900 con 0x7f5d880bfd60 2020-11-20T11:29:35.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d78011a60 con 0x7f5d880bfd60 2020-11-20T11:29:35.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78011de0 con 0x7f5d880bfd60 2020-11-20T11:29:35.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8813e610 con 0x7f5d880bfd60 2020-11-20T11:29:35.628 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.617+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d880c1f50 con 0x7f5d880bfd60 2020-11-20T11:29:35.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.618+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88044f60 con 0x7f5d880bfd60 2020-11-20T11:29:35.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.618+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5d78019630 con 0x7f5d880bfd60 2020-11-20T11:29:35.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.619+0000 7f5d75ffb700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 0x7f5d60082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.619+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5d780a6690 con 0x7f5d880bfd60 2020-11-20T11:29:35.629 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.619+0000 7f5d8d5c0700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 0x7f5d60082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.619+0000 7f5d8d5c0700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 0x7f5d60082af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f5d88151ce0 tx=0x7f5d84015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.622+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5d7807b0a0 con 0x7f5d880bfd60 2020-11-20T11:29:35.786 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.783+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d88146100 con 0x7f5d880bfd60 2020-11-20T11:29:35.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.784+0000 7f5d75ffb700 1 -- 172.21.15.105:0/2460746184 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f5d7801e030 con 0x7f5d880bfd60 2020-11-20T11:29:35.788 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:35.788 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:35.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 msgr2=0x7f5d60082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 0x7f5d60082af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f5d88151ce0 tx=0x7f5d84015000).stop 2020-11-20T11:29:35.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 msgr2=0x7f5d88067190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5d78001e50 tx=0x7f5d78007c10).stop 2020-11-20T11:29:35.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 shutdown_connections 2020-11-20T11:29:35.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d881518e0 0x7f5d881428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f5d60080630 0x7f5d60082af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d880bfd60 0x7f5d88067190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 --2- 172.21.15.105:0/2460746184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d8814dbc0 0x7f5d881423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 >> 172.21.15.105:0/2460746184 conn(0x7f5d880b9910 msgr2=0x7f5d880c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 shutdown_connections 2020-11-20T11:29:35.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.786+0000 7f5d90025700 1 -- 172.21.15.105:0/2460746184 wait complete. 2020-11-20T11:29:35.800 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:29:11.234336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:29:24.196669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:29:27.352951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:29:29.818965+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:29:35.801 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:29:35.802 INFO:tasks.ceph.mds.c.smithi067.stderr:2020-11-20T11:29:35.798+0000 7f47c6e40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T11:29:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.918+0000 7f861063c700 1 Processor -- start 2020-11-20T11:29:35.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.918+0000 7f861063c700 1 -- start start 2020-11-20T11:29:35.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f861063c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f860809ad30 0x7f86080c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f861063c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86080c37f0 0x7f860814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f861063c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080bde30 con 0x7f860814b410 2020-11-20T11:29:35.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f861063c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080beae0 con 0x7f86080c37f0 2020-11-20T11:29:35.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f861063c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860814de60 con 0x7f860809ad30 2020-11-20T11:29:35.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f860dbd7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f860809ad30 0x7f86080c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f860e3d8700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f860814b410 0x7f8608065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60150/0 (socket says 172.21.15.105:60150) 2020-11-20T11:29:35.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f860e3d8700 1 -- 172.21.15.105:0/1742402212 learned_addr learned my addr 172.21.15.105:0/1742402212 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:35.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f860dbd7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f860809ad30 0x7f86080c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59660/0 (socket says 172.21.15.105:59660) 2020-11-20T11:29:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.919+0000 7f860ebd9700 1 --2- 172.21.15.105:0/1742402212 >> v2:172.21.15.67:3300/0 conn(0x7f86080c37f0 0x7f860814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860dbd7700 1 -- 172.21.15.105:0/1742402212 >> v2:172.21.15.67:3300/0 conn(0x7f86080c37f0 msgr2=0x7f860814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860dbd7700 1 --2- 172.21.15.105:0/1742402212 >> v2:172.21.15.67:3300/0 conn(0x7f86080c37f0 0x7f860814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860dbd7700 1 -- 172.21.15.105:0/1742402212 >> v1:172.21.15.100:6789/0 conn(0x7f860814b410 legacy=0x7f8608065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860dbd7700 1 -- 172.21.15.105:0/1742402212 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080be060 con 0x7f860809ad30 2020-11-20T11:29:35.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860d3d6700 1 -- 172.21.15.105:0/1742402212 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075269790 0 0) 0x7f86080bde30 con 0x7f860814b410 2020-11-20T11:29:35.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860dbd7700 1 --2- 172.21.15.105:0/1742402212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f860809ad30 0x7f86080c3300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f86080bd620 tx=0x7f8604006d90).ready entity=mon.1 client_cookie=7ea2d78aef603952 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860d3d6700 1 -- 172.21.15.105:0/1742402212 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604006030 con 0x7f860809ad30 2020-11-20T11:29:35.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860d3d6700 1 -- 172.21.15.105:0/1742402212 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604006190 con 0x7f860809ad30 2020-11-20T11:29:35.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f860d3d6700 1 -- 172.21.15.105:0/1742402212 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604006510 con 0x7f860809ad30 2020-11-20T11:29:35.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f861063c700 1 -- 172.21.15.105:0/1742402212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f860809ad30 msgr2=0x7f86080c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.920+0000 7f861063c700 1 --2- 172.21.15.105:0/1742402212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f860809ad30 0x7f86080c3300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f86080bd620 tx=0x7f8604006d90).stop 2020-11-20T11:29:35.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 -- 172.21.15.105:0/1742402212 shutdown_connections 2020-11-20T11:29:35.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 --2- 172.21.15.105:0/1742402212 >> v2:172.21.15.67:3300/0 conn(0x7f86080c37f0 0x7f860814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 --2- 172.21.15.105:0/1742402212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f860809ad30 0x7f86080c3300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 -- 172.21.15.105:0/1742402212 >> 172.21.15.105:0/1742402212 conn(0x7f86080b9890 msgr2=0x7f86080b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:35.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 -- 172.21.15.105:0/1742402212 shutdown_connections 2020-11-20T11:29:35.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.921+0000 7f861063c700 1 -- 172.21.15.105:0/1742402212 wait complete. 2020-11-20T11:29:35.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 Processor -- start 2020-11-20T11:29:35.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 -- start start 2020-11-20T11:29:35.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86080c37f0 0x7f860814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f860814b410 0x7f860814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860814f980 con 0x7f860814b410 2020-11-20T11:29:35.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860814ce70 con 0x7f86080c37f0 2020-11-20T11:29:35.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f861063c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860814d110 con 0x7f860809ad30 2020-11-20T11:29:35.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.922+0000 7f860e3d8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41536/0 (socket says 172.21.15.105:41536) 2020-11-20T11:29:35.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 -- 172.21.15.105:0/2080330564 learned_addr learned my addr 172.21.15.105:0/2080330564 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:35.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860dbd7700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86080c37f0 0x7f860814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860ebd9700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f860814b410 0x7f860814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 -- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86080c37f0 msgr2=0x7f860814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86080c37f0 0x7f860814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 -- 172.21.15.105:0/2080330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f860814b410 msgr2=0x7f860814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f860814b410 0x7f860814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 -- 172.21.15.105:0/2080330564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860814d3b0 con 0x7f860809ad30 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f860e3d8700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f85f800c790 tx=0x7f85f8007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80072e0 con 0x7f860809ad30 2020-11-20T11:29:35.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860814d650 con 0x7f860809ad30 2020-11-20T11:29:35.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f8007440 con 0x7f860809ad30 2020-11-20T11:29:35.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8005840 con 0x7f860809ad30 2020-11-20T11:29:35.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.923+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8608150680 con 0x7f860809ad30 2020-11-20T11:29:35.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.924+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608044f60 con 0x7f860809ad30 2020-11-20T11:29:35.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.925+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f85f8010070 con 0x7f860809ad30 2020-11-20T11:29:35.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.925+0000 7f85f67fc700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 0x7f85e0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:35.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.925+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f85f80a1ff0 con 0x7f860809ad30 2020-11-20T11:29:35.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.925+0000 7f860dbd7700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 0x7f85e0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:35.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.926+0000 7f860dbd7700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 0x7f85e0082af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f86080bd620 tx=0x7f8604015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:35.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:35.929+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f85f8076a90 con 0x7f860809ad30 2020-11-20T11:29:36.092 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.088+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f86080ba540 con 0x7f860809ad30 2020-11-20T11:29:36.092 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.089+0000 7f85f67fc700 1 -- 172.21.15.105:0/2080330564 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f85f807a0b0 con 0x7f860809ad30 2020-11-20T11:29:36.093 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2020-11-20T11:29:36.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 msgr2=0x7f85e0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 0x7f85e0082af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f86080bd620 tx=0x7f8604015000).stop 2020-11-20T11:29:36.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 msgr2=0x7f860814c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f85f800c790 tx=0x7f85f8007c90).stop 2020-11-20T11:29:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 shutdown_connections 2020-11-20T11:29:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f860814b410 0x7f860814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f85e0080630 0x7f85e0082af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f860809ad30 0x7f860814c860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 --2- 172.21.15.105:0/2080330564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86080c37f0 0x7f860814e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 >> 172.21.15.105:0/2080330564 conn(0x7f86080b9890 msgr2=0x7f8608144020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 shutdown_connections 2020-11-20T11:29:36.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.090+0000 7f861063c700 1 -- 172.21.15.105:0/2080330564 wait complete. 2020-11-20T11:29:36.105 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:29:36.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 Processor -- start 2020-11-20T11:29:36.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 -- start start 2020-11-20T11:29:36.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb8c414b410 0x7fb8c4065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40bde30 con 0x7fb8c40c3a10 2020-11-20T11:29:36.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c414de60 con 0x7fb8c409ad30 2020-11-20T11:29:36.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.222+0000 7fb8cb134700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c40beae0 con 0x7fb8c414b410 2020-11-20T11:29:36.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb8c414b410 0x7fb8c4065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb8c414b410 0x7fb8c4065570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41544/0 (socket says 172.21.15.105:41544) 2020-11-20T11:29:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 -- 172.21.15.105:0/3160455740 learned_addr learned my addr 172.21.15.105:0/3160455740 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 -- 172.21.15.105:0/3160455740 >> v1:172.21.15.100:6789/0 conn(0x7fb8c409ad30 legacy=0x7fb8c40c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 -- 172.21.15.105:0/3160455740 >> v1:172.21.15.67:6789/0 conn(0x7fb8c40c3a10 legacy=0x7fb8c414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 -- 172.21.15.105:0/3160455740 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40be060 con 0x7fb8c414b410 2020-11-20T11:29:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c8ed0700 1 --2- 172.21.15.105:0/3160455740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c414b410 0x7fb8c4065570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb8b4006fd0 tx=0x7fb8b4006eb0).ready entity=mon.2 client_cookie=9a379e7f0a313771 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c37fe700 1 -- 172.21.15.105:0/3160455740 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40098d0 con 0x7fb8c414b410 2020-11-20T11:29:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c37fe700 1 -- 172.21.15.105:0/3160455740 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4009a30 con 0x7fb8c414b410 2020-11-20T11:29:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.223+0000 7fb8c37fe700 1 -- 172.21.15.105:0/3160455740 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4009db0 con 0x7fb8c414b410 2020-11-20T11:29:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 -- 172.21.15.105:0/3160455740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c414b410 msgr2=0x7fb8c4065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 --2- 172.21.15.105:0/3160455740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c414b410 0x7fb8c4065570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb8b4006fd0 tx=0x7fb8b4006eb0).stop 2020-11-20T11:29:36.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 -- 172.21.15.105:0/3160455740 shutdown_connections 2020-11-20T11:29:36.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 --2- 172.21.15.105:0/3160455740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c414b410 0x7fb8c4065570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 -- 172.21.15.105:0/3160455740 >> 172.21.15.105:0/3160455740 conn(0x7fb8c40b9890 msgr2=0x7fb8c40b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 -- 172.21.15.105:0/3160455740 shutdown_connections 2020-11-20T11:29:36.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.224+0000 7fb8cb134700 1 -- 172.21.15.105:0/3160455740 wait complete. 2020-11-20T11:29:36.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.225+0000 7fb8cb134700 1 Processor -- start 2020-11-20T11:29:36.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.225+0000 7fb8cb134700 1 -- start start 2020-11-20T11:29:36.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c4065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 0x7fb8c40ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c414d490 con 0x7fb8c409ad30 2020-11-20T11:29:36.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4152830 con 0x7fb8c414b410 2020-11-20T11:29:36.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4152ad0 con 0x7fb8c40c3a10 2020-11-20T11:29:36.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41552/0 (socket says 172.21.15.105:41552) 2020-11-20T11:29:36.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 -- 172.21.15.105:0/2421003602 learned_addr learned my addr 172.21.15.105:0/2421003602 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c96d1700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 0x7fb8c40ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c8ed0700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c4065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 -- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 msgr2=0x7fb8c40ba9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 0x7fb8c40ba9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 -- 172.21.15.105:0/2421003602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 msgr2=0x7fb8c4065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c4065790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 -- 172.21.15.105:0/2421003602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4152d70 con 0x7fb8c40c3a10 2020-11-20T11:29:36.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c96d1700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 0x7fb8c40ba9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:36.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c3fff700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb8b800c710 tx=0x7fb8b8007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800e560 con 0x7fb8c40c3a10 2020-11-20T11:29:36.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800e6c0 con 0x7fb8c40c3a10 2020-11-20T11:29:36.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4153010 con 0x7fb8c40c3a10 2020-11-20T11:29:36.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800ea60 con 0x7fb8c40c3a10 2020-11-20T11:29:36.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.226+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c414d020 con 0x7fb8c40c3a10 2020-11-20T11:29:36.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.227+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c41533d0 con 0x7fb8c40c3a10 2020-11-20T11:29:36.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.228+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb8b8010030 con 0x7fb8c40c3a10 2020-11-20T11:29:36.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.228+0000 7fb8c0ff9700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.228+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb8b80a2590 con 0x7fb8c40c3a10 2020-11-20T11:29:36.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.229+0000 7fb8c8ed0700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.229+0000 7fb8c8ed0700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb8b400b1b0 tx=0x7fb8b4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.232+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb8b8076f20 con 0x7fb8c40c3a10 2020-11-20T11:29:36.397 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.393+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8c414de60 con 0x7fb8c40c3a10 2020-11-20T11:29:36.397 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.394+0000 7fb8c0ff9700 1 -- 172.21.15.105:0/2421003602 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8c414de60 con 0x7fb8c40c3a10 2020-11-20T11:29:36.398 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:36.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 msgr2=0x7fb89c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb8b400b1b0 tx=0x7fb8b4015000).stop 2020-11-20T11:29:36.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 msgr2=0x7fb8c414cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.399 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb8b800c710 tx=0x7fb8b8007c20).stop 2020-11-20T11:29:36.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 shutdown_connections 2020-11-20T11:29:36.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c414b410 0x7fb8c40ba9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8c409ad30 0x7fb8c4065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb89c080630 0x7fb89c082af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 --2- 172.21.15.105:0/2421003602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8c40c3a10 0x7fb8c414cb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 >> 172.21.15.105:0/2421003602 conn(0x7fb8c40b9890 msgr2=0x7fb8c40bff50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 shutdown_connections 2020-11-20T11:29:36.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.395+0000 7fb8cb134700 1 -- 172.21.15.105:0/2421003602 wait complete. 2020-11-20T11:29:36.410 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:29:36.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.526+0000 7f3057f4a700 1 Processor -- start 2020-11-20T11:29:36.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.526+0000 7f3057f4a700 1 -- start start 2020-11-20T11:29:36.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3057f4a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f305014b410 0x7f3050065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3057f4a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500bde30 con 0x7f30500c3a10 2020-11-20T11:29:36.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3057f4a700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305014de60 con 0x7f305009ad30 2020-11-20T11:29:36.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3057f4a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500beae0 con 0x7f305014b410 2020-11-20T11:29:36.532 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f305014b410 0x7f3050065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.533 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f305014b410 0x7f3050065570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41558/0 (socket says 172.21.15.105:41558) 2020-11-20T11:29:36.533 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 -- 172.21.15.105:0/688201766 learned_addr learned my addr 172.21.15.105:0/688201766 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.533 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 -- 172.21.15.105:0/688201766 >> v1:172.21.15.100:6789/0 conn(0x7f305009ad30 legacy=0x7f30500c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.533 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 -- 172.21.15.105:0/688201766 >> v1:172.21.15.67:6789/0 conn(0x7f30500c3a10 legacy=0x7f305014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.533 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.527+0000 7f3055ce6700 1 -- 172.21.15.105:0/688201766 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500be060 con 0x7f305014b410 2020-11-20T11:29:36.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3055ce6700 1 --2- 172.21.15.105:0/688201766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f305014b410 0x7f3050065570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f3040006eb0).ready entity=mon.2 client_cookie=c1504da3f8f430f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3054ce4700 1 -- 172.21.15.105:0/688201766 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400098d0 con 0x7f305014b410 2020-11-20T11:29:36.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3054ce4700 1 -- 172.21.15.105:0/688201766 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040009a30 con 0x7f305014b410 2020-11-20T11:29:36.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3054ce4700 1 -- 172.21.15.105:0/688201766 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040009db0 con 0x7f305014b410 2020-11-20T11:29:36.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 -- 172.21.15.105:0/688201766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f305014b410 msgr2=0x7f3050065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 --2- 172.21.15.105:0/688201766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f305014b410 0x7f3050065570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f3040006eb0).stop 2020-11-20T11:29:36.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 -- 172.21.15.105:0/688201766 shutdown_connections 2020-11-20T11:29:36.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 --2- 172.21.15.105:0/688201766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f305014b410 0x7f3050065570 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 -- 172.21.15.105:0/688201766 >> 172.21.15.105:0/688201766 conn(0x7f30500b9890 msgr2=0x7f30500b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 -- 172.21.15.105:0/688201766 shutdown_connections 2020-11-20T11:29:36.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.528+0000 7f3057f4a700 1 -- 172.21.15.105:0/688201766 wait complete. 2020-11-20T11:29:36.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.529+0000 7f3057f4a700 1 Processor -- start 2020-11-20T11:29:36.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.529+0000 7f3057f4a700 1 -- start start 2020-11-20T11:29:36.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305009ad30 0x7f3050164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f305014b410 0x7f30500c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050161120 con 0x7f305009ad30 2020-11-20T11:29:36.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501613c0 con 0x7f305014b410 2020-11-20T11:29:36.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3057f4a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050161660 con 0x7f30500c3a10 2020-11-20T11:29:36.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41566/0 (socket says 172.21.15.105:41566) 2020-11-20T11:29:36.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 -- 172.21.15.105:0/2566790160 learned_addr learned my addr 172.21.15.105:0/2566790160 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30564e7700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f305014b410 0x7f30500c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f3055ce6700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305009ad30 0x7f3050164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 -- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f305014b410 msgr2=0x7f30500c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f305014b410 0x7f30500c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 -- 172.21.15.105:0/2566790160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305009ad30 msgr2=0x7f3050164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305009ad30 0x7f3050164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.530+0000 7f30554e5700 1 -- 172.21.15.105:0/2566790160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050161900 con 0x7f30500c3a10 2020-11-20T11:29:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f30554e5700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f304c00c710 tx=0x7f304c007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00e560 con 0x7f30500c3a10 2020-11-20T11:29:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00e6c0 con 0x7f30500c3a10 2020-11-20T11:29:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3050161ba0 con 0x7f30500c3a10 2020-11-20T11:29:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00ea60 con 0x7f30500c3a10 2020-11-20T11:29:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.531+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050145780 con 0x7f30500c3a10 2020-11-20T11:29:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.532+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3050148bd0 con 0x7f30500c3a10 2020-11-20T11:29:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.532+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f304c010030 con 0x7f30500c3a10 2020-11-20T11:29:36.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.533+0000 7f303dffb700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 0x7f3028082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.533+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f304c0a2490 con 0x7f30500c3a10 2020-11-20T11:29:36.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.533+0000 7f3055ce6700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 0x7f3028082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.533+0000 7f3055ce6700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 0x7f3028082af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f304000b1b0 tx=0x7f3040015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.536+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f304c076ea0 con 0x7f30500c3a10 2020-11-20T11:29:36.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.698+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f305014de60 con 0x7f30500c3a10 2020-11-20T11:29:36.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.698+0000 7f303dffb700 1 -- 172.21.15.105:0/2566790160 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7f305014de60 con 0x7f30500c3a10 2020-11-20T11:29:36.702 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:36.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 msgr2=0x7f3028082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 0x7f3028082af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f304000b1b0 tx=0x7f3040015000).stop 2020-11-20T11:29:36.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 msgr2=0x7f305014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f304c00c710 tx=0x7f304c007c20).stop 2020-11-20T11:29:36.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 shutdown_connections 2020-11-20T11:29:36.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f305014b410 0x7f30500c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305009ad30 0x7f3050164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f3028080630 0x7f3028082af0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 --2- 172.21.15.105:0/2566790160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500c3a10 0x7f305014e380 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 >> 172.21.15.105:0/2566790160 conn(0x7f30500b9890 msgr2=0x7f30500bc280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 shutdown_connections 2020-11-20T11:29:36.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.700+0000 7f3057f4a700 1 -- 172.21.15.105:0/2566790160 wait complete. 2020-11-20T11:29:36.714 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:29:36.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.832+0000 7fbb20a19700 1 Processor -- start 2020-11-20T11:29:36.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.832+0000 7fbb20a19700 1 -- start start 2020-11-20T11:29:36.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb20a19700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbb1c14b410 0x7fbb1c065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb20a19700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb1c0c3a10 0x7fbb1c065a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb20a19700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0bde30 con 0x7fbb1c09ad30 2020-11-20T11:29:36.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb20a19700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c0beae0 con 0x7fbb1c14b410 2020-11-20T11:29:36.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb20a19700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c14de60 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb1c0c3a10 0x7fbb1c065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb1c0c3a10 0x7fbb1c065a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41570/0 (socket says 172.21.15.105:41570) 2020-11-20T11:29:36.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 -- 172.21.15.105:0/3477682072 learned_addr learned my addr 172.21.15.105:0/3477682072 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1a59c700 1 --2- 172.21.15.105:0/3477682072 >> v2:172.21.15.67:3300/0 conn(0x7fbb1c14b410 0x7fbb1c065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 -- 172.21.15.105:0/3477682072 >> v2:172.21.15.67:3300/0 conn(0x7fbb1c14b410 msgr2=0x7fbb1c065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:36.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 --2- 172.21.15.105:0/3477682072 >> v2:172.21.15.67:3300/0 conn(0x7fbb1c14b410 0x7fbb1c065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 -- 172.21.15.105:0/3477682072 >> v1:172.21.15.67:6789/0 conn(0x7fbb1c09ad30 legacy=0x7fbb1c0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.833+0000 7fbb1ad9d700 1 -- 172.21.15.105:0/3477682072 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0be060 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb1ad9d700 1 --2- 172.21.15.105:0/3477682072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c065a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbb1c067c70 tx=0x7fbb14009290).ready entity=mon.2 client_cookie=5e80a80a272f5a12 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb1959a700 1 -- 172.21.15.105:0/3477682072 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400bbc0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb1959a700 1 -- 172.21.15.105:0/3477682072 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400bd20 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb1959a700 1 -- 172.21.15.105:0/3477682072 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14011610 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 -- 172.21.15.105:0/3477682072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 msgr2=0x7fbb1c065a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3477682072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c065a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbb1c067c70 tx=0x7fbb14009290).stop 2020-11-20T11:29:36.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 -- 172.21.15.105:0/3477682072 shutdown_connections 2020-11-20T11:29:36.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3477682072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c065a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3477682072 >> v2:172.21.15.67:3300/0 conn(0x7fbb1c14b410 0x7fbb1c065570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 -- 172.21.15.105:0/3477682072 >> 172.21.15.105:0/3477682072 conn(0x7fbb1c0b9890 msgr2=0x7fbb1c0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:36.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 -- 172.21.15.105:0/3477682072 shutdown_connections 2020-11-20T11:29:36.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.834+0000 7fbb20a19700 1 -- 172.21.15.105:0/3477682072 wait complete. 2020-11-20T11:29:36.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.835+0000 7fbb20a19700 1 Processor -- start 2020-11-20T11:29:36.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.835+0000 7fbb20a19700 1 -- start start 2020-11-20T11:29:36.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb1c09ad30 0x7fbb1c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 0x7fbb1c15e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c161cc0 con 0x7fbb1c14b410 2020-11-20T11:29:36.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c161f60 con 0x7fbb1c09ad30 2020-11-20T11:29:36.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb20a19700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c162200 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41574/0 (socket says 172.21.15.105:41574) 2020-11-20T11:29:36.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 -- 172.21.15.105:0/3088482811 learned_addr learned my addr 172.21.15.105:0/3088482811 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:36.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb1a59c700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb1c09ad30 0x7fbb1c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb1ad9d700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 0x7fbb1c15e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 -- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb1c09ad30 msgr2=0x7fbb1c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb1c09ad30 0x7fbb1c150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 -- 172.21.15.105:0/3088482811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 msgr2=0x7fbb1c15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:36.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 0x7fbb1c15e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:36.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.836+0000 7fbb19d9b700 1 -- 172.21.15.105:0/3088482811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c1624a0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb1ad9d700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 0x7fbb1c15e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:36.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb19d9b700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbb0c00c710 tx=0x7fbb0c007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c001ea0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00e560 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00e900 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c162740 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.837+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c1522b0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.838+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c1628d0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.838+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbb0c010030 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.839+0000 7fbb0a7fc700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 0x7fbaf0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:36.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.839+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbb0c0a27b0 con 0x7fbb1c0c3a10 2020-11-20T11:29:36.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.839+0000 7fbb1a59c700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 0x7fbaf0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:36.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.839+0000 7fbb1a59c700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 0x7fbaf0082af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbb10006fd0 tx=0x7fbb10008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:36.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:36.842+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbb0c0771c0 con 0x7fbb1c0c3a10 2020-11-20T11:29:37.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.005+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb1c044f60 con 0x7fbb1c0c3a10 2020-11-20T11:29:37.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.005+0000 7fbb0a7fc700 1 -- 172.21.15.105:0/3088482811 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbb0c07a7e0 con 0x7fbb1c0c3a10 2020-11-20T11:29:37.009 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:37.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 msgr2=0x7fbaf0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 0x7fbaf0082af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbb10006fd0 tx=0x7fbb10008040).stop 2020-11-20T11:29:37.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 msgr2=0x7fbb1c1489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbb0c00c710 tx=0x7fbb0c007bd0).stop 2020-11-20T11:29:37.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 shutdown_connections 2020-11-20T11:29:37.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb1c14b410 0x7fbb1c15e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb1c09ad30 0x7fbb1c150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbaf0080630 0x7fbaf0082af0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 --2- 172.21.15.105:0/3088482811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb1c0c3a10 0x7fbb1c1489e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 >> 172.21.15.105:0/3088482811 conn(0x7fbb1c0b9890 msgr2=0x7fbb1c0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 shutdown_connections 2020-11-20T11:29:37.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.006+0000 7fbb20a19700 1 -- 172.21.15.105:0/3088482811 wait complete. 2020-11-20T11:29:37.021 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T11:29:37.021 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T11:29:37.022 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T11:29:37.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.135+0000 7f2e68711700 1 Processor -- start 2020-11-20T11:29:37.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.135+0000 7f2e68711700 1 -- start start 2020-11-20T11:29:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e68711700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2e6014b670 0x7f2e600c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e68711700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e600bfdd0 0x7f2e600c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e68711700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6014e210 con 0x7f2e600c37e0 2020-11-20T11:29:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e68711700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6014e4b0 con 0x7f2e6014b670 2020-11-20T11:29:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e68711700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6014e750 con 0x7f2e600bfdd0 2020-11-20T11:29:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e600bfdd0 0x7f2e600c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e664ad700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2e600c37e0 0x7f2e6014af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41184/0 (socket says 172.21.15.105:41184) 2020-11-20T11:29:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e664ad700 1 -- 172.21.15.105:0/2282663338 learned_addr learned my addr 172.21.15.105:0/2282663338 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e65cac700 1 --2- 172.21.15.105:0/2282663338 >> v2:172.21.15.67:3300/0 conn(0x7f2e6014b670 0x7f2e600c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 -- 172.21.15.105:0/2282663338 >> v2:172.21.15.67:3300/0 conn(0x7f2e6014b670 msgr2=0x7f2e600c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 --2- 172.21.15.105:0/2282663338 >> v2:172.21.15.67:3300/0 conn(0x7f2e6014b670 0x7f2e600c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 -- 172.21.15.105:0/2282663338 >> v1:172.21.15.105:6789/0 conn(0x7f2e600c37e0 legacy=0x7f2e6014af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 -- 172.21.15.105:0/2282663338 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6014e9f0 con 0x7f2e600bfdd0 2020-11-20T11:29:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e654ab700 1 -- 172.21.15.105:0/2282663338 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992769539 0 0) 0x7f2e6014e210 con 0x7f2e600c37e0 2020-11-20T11:29:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e66cae700 1 --2- 172.21.15.105:0/2282663338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600bfdd0 0x7f2e600c0210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2e60068280 tx=0x7f2e5c006df0).ready entity=mon.2 client_cookie=bb6bb4a54a95b5c7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e654ab700 1 -- 172.21.15.105:0/2282663338 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0097b0 con 0x7f2e600bfdd0 2020-11-20T11:29:37.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e654ab700 1 -- 172.21.15.105:0/2282663338 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c009910 con 0x7f2e600bfdd0 2020-11-20T11:29:37.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.136+0000 7f2e654ab700 1 -- 172.21.15.105:0/2282663338 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009c90 con 0x7f2e600bfdd0 2020-11-20T11:29:37.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 -- 172.21.15.105:0/2282663338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600bfdd0 msgr2=0x7f2e600c0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 --2- 172.21.15.105:0/2282663338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600bfdd0 0x7f2e600c0210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2e60068280 tx=0x7f2e5c006df0).stop 2020-11-20T11:29:37.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 -- 172.21.15.105:0/2282663338 shutdown_connections 2020-11-20T11:29:37.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 --2- 172.21.15.105:0/2282663338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600bfdd0 0x7f2e600c0210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 --2- 172.21.15.105:0/2282663338 >> v2:172.21.15.67:3300/0 conn(0x7f2e6014b670 0x7f2e600c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 -- 172.21.15.105:0/2282663338 >> 172.21.15.105:0/2282663338 conn(0x7f2e600b9910 msgr2=0x7f2e600b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 -- 172.21.15.105:0/2282663338 shutdown_connections 2020-11-20T11:29:37.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.137+0000 7f2e68711700 1 -- 172.21.15.105:0/2282663338 wait complete. 2020-11-20T11:29:37.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.138+0000 7f2e68711700 1 Processor -- start 2020-11-20T11:29:37.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.138+0000 7f2e68711700 1 -- start start 2020-11-20T11:29:37.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e600bfdd0 0x7f2e60151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 0x7f2e60141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601422b0 con 0x7f2e600bfdd0 2020-11-20T11:29:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6013f950 con 0x7f2e6014b670 2020-11-20T11:29:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6013fbf0 con 0x7f2e600c37e0 2020-11-20T11:29:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41588/0 (socket says 172.21.15.105:41588) 2020-11-20T11:29:37.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 -- 172.21.15.105:0/2993174581 learned_addr learned my addr 172.21.15.105:0/2993174581 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:37.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e664ad700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e600bfdd0 0x7f2e60151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e66cae700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 0x7f2e60141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 -- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 msgr2=0x7f2e60141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 0x7f2e60141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 -- 172.21.15.105:0/2993174581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e600bfdd0 msgr2=0x7f2e60151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e600bfdd0 0x7f2e60151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 -- 172.21.15.105:0/2993174581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6013fe90 con 0x7f2e600c37e0 2020-11-20T11:29:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e66cae700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 0x7f2e60141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e65cac700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2e5000db60 tx=0x7f2e50008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50009820 con 0x7f2e600c37e0 2020-11-20T11:29:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50009980 con 0x7f2e600c37e0 2020-11-20T11:29:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60140130 con 0x7f2e600c37e0 2020-11-20T11:29:37.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50009d40 con 0x7f2e600c37e0 2020-11-20T11:29:37.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.139+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60152050 con 0x7f2e600c37e0 2020-11-20T11:29:37.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.140+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e60140590 con 0x7f2e600c37e0 2020-11-20T11:29:37.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.141+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2e50012630 con 0x7f2e600c37e0 2020-11-20T11:29:37.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.141+0000 7f2e4e7fc700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 0x7f2e38082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.142+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2e500a2ea0 con 0x7f2e600c37e0 2020-11-20T11:29:37.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.142+0000 7f2e664ad700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 0x7f2e38082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.142+0000 7f2e664ad700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 0x7f2e38082af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2e58007fd0 tx=0x7f2e58009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.145+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2e500778b0 con 0x7f2e600c37e0 2020-11-20T11:29:37.350 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.346+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e60044f60 con 0x7f2e600c37e0 2020-11-20T11:29:37.353 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.350+0000 7f2e4e7fc700 1 -- 172.21.15.105:0/2993174581 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+202045 (secure 0 0 0) 0x7f2e5007aed0 con 0x7f2e600c37e0 2020-11-20T11:29:37.356 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:37.357 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 msgr2=0x7f2e38082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.358 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 0x7f2e38082af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2e58007fd0 tx=0x7f2e58009040).stop 2020-11-20T11:29:37.358 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 msgr2=0x7f2e600c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.358 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2e5000db60 tx=0x7f2e50008040).stop 2020-11-20T11:29:37.358 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 shutdown_connections 2020-11-20T11:29:37.359 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e6014b670 0x7f2e60141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.359 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e600bfdd0 0x7f2e60151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.359 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2e38080630 0x7f2e38082af0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.359 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 --2- 172.21.15.105:0/2993174581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e600c37e0 0x7f2e600c2640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.359 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 >> 172.21.15.105:0/2993174581 conn(0x7f2e600b9910 msgr2=0x7f2e600628c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 shutdown_connections 2020-11-20T11:29:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.352+0000 7f2e68711700 1 -- 172.21.15.105:0/2993174581 wait complete. 2020-11-20T11:29:37.367 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":4,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":24394},{"type":"v1","addr":"172.21.15.100:6801","nonce":24394}]},"active_addr":"172.21.15.100:6801/24394","active_change":"2020-11-20T11:29:11.189063+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4113,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2840562737}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2337524009}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1277961876}]}]}} 2020-11-20T11:29:37.372 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T11:29:37.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T11:29:37.373 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:37.523 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.520+0000 7f0a7beb5700 1 Processor -- start 2020-11-20T11:29:37.524 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.520+0000 7f0a7beb5700 1 -- start start 2020-11-20T11:29:37.526 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7beb5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a741518e0 0x7f0a740c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.526 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7beb5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a7414dbc0 0x7f0a7414e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.526 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7beb5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a74061d20 con 0x7f0a740bfd60 2020-11-20T11:29:37.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7beb5700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740be1c0 con 0x7f0a7414dbc0 2020-11-20T11:29:37.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7beb5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740be460 con 0x7f0a741518e0 2020-11-20T11:29:37.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a741518e0 0x7f0a740c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a741518e0 0x7f0a740c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41598/0 (socket says 172.21.15.105:41598) 2020-11-20T11:29:37.527 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 -- 172.21.15.105:0/101707839 learned_addr learned my addr 172.21.15.105:0/101707839 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:37.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a7a452700 1 --2- 172.21.15.105:0/101707839 >> v2:172.21.15.100:3300/0 conn(0x7f0a7414dbc0 0x7f0a7414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 -- 172.21.15.105:0/101707839 >> v2:172.21.15.100:3300/0 conn(0x7f0a7414dbc0 msgr2=0x7f0a7414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:37.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 --2- 172.21.15.105:0/101707839 >> v2:172.21.15.100:3300/0 conn(0x7f0a7414dbc0 0x7f0a7414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 -- 172.21.15.105:0/101707839 >> v1:172.21.15.67:6789/0 conn(0x7f0a740bfd60 legacy=0x7f0a74067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:37.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 -- 172.21.15.105:0/101707839 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7414d790 con 0x7f0a741518e0 2020-11-20T11:29:37.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.521+0000 7f0a79450700 1 --2- 172.21.15.105:0/101707839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a741518e0 0x7f0a740c0140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0a740648d0 tx=0x7f0a70006eb0).ready entity=mon.2 client_cookie=3b99e39479f186dc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a78c4f700 1 -- 172.21.15.105:0/101707839 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700097d0 con 0x7f0a741518e0 2020-11-20T11:29:37.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a78c4f700 1 -- 172.21.15.105:0/101707839 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70009930 con 0x7f0a741518e0 2020-11-20T11:29:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a78c4f700 1 -- 172.21.15.105:0/101707839 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70009cb0 con 0x7f0a741518e0 2020-11-20T11:29:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 -- 172.21.15.105:0/101707839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a741518e0 msgr2=0x7f0a740c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/101707839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a741518e0 0x7f0a740c0140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0a740648d0 tx=0x7f0a70006eb0).stop 2020-11-20T11:29:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 -- 172.21.15.105:0/101707839 shutdown_connections 2020-11-20T11:29:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/101707839 >> v2:172.21.15.100:3300/0 conn(0x7f0a7414dbc0 0x7f0a7414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/101707839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a741518e0 0x7f0a740c0140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 -- 172.21.15.105:0/101707839 >> 172.21.15.105:0/101707839 conn(0x7f0a740b9910 msgr2=0x7f0a740b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 -- 172.21.15.105:0/101707839 shutdown_connections 2020-11-20T11:29:37.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.522+0000 7f0a7beb5700 1 -- 172.21.15.105:0/101707839 wait complete. 2020-11-20T11:29:37.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.523+0000 7f0a7beb5700 1 Processor -- start 2020-11-20T11:29:37.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.523+0000 7f0a7beb5700 1 -- start start 2020-11-20T11:29:37.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 0x7f0a7408ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.534 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 0x7f0a74150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740bde20 con 0x7f0a741518e0 2020-11-20T11:29:37.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74092820 con 0x7f0a740bfd60 2020-11-20T11:29:37.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7beb5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7415c360 con 0x7f0a7414dbc0 2020-11-20T11:29:37.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41602/0 (socket says 172.21.15.105:41602) 2020-11-20T11:29:37.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 -- 172.21.15.105:0/452234854 learned_addr learned my addr 172.21.15.105:0/452234854 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:37.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79c51700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 0x7f0a7408ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7a452700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 0x7f0a74150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 -- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 msgr2=0x7f0a7408ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 0x7f0a7408ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 -- 172.21.15.105:0/452234854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 msgr2=0x7f0a74150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 0x7f0a74150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 -- 172.21.15.105:0/452234854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74092a80 con 0x7f0a7414dbc0 2020-11-20T11:29:37.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79c51700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 0x7f0a7408ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:37.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a7a452700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 0x7f0a74150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:37.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a79450700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0a70009fd0 tx=0x7f0a70015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.524+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011e50 con 0x7f0a7414dbc0 2020-11-20T11:29:37.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.525+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7001e460 con 0x7f0a7414dbc0 2020-11-20T11:29:37.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.525+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74092d20 con 0x7f0a7414dbc0 2020-11-20T11:29:37.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.525+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7001e7e0 con 0x7f0a7414dbc0 2020-11-20T11:29:37.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.525+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7415c5d0 con 0x7f0a7414dbc0 2020-11-20T11:29:37.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.526+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74044f60 con 0x7f0a7414dbc0 2020-11-20T11:29:37.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.526+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0a70025030 con 0x7f0a7414dbc0 2020-11-20T11:29:37.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.527+0000 7f0a61ffb700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 0x7f0a4c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.527+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0a700a4390 con 0x7f0a7414dbc0 2020-11-20T11:29:37.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.527+0000 7f0a79c51700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 0x7f0a4c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.527+0000 7f0a79c51700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 0x7f0a4c082af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0a64002590 tx=0x7f0a64009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.530+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0a70078da0 con 0x7f0a7414dbc0 2020-11-20T11:29:37.698 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.694+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a74062d60 con 0x7f0a7414dbc0 2020-11-20T11:29:37.699 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.695+0000 7f0a61ffb700 1 -- 172.21.15.105:0/452234854 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f0a70023070 con 0x7f0a7414dbc0 2020-11-20T11:29:37.699 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:37.699 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:37.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 msgr2=0x7f0a4c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 0x7f0a4c082af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0a64002590 tx=0x7f0a64009040).stop 2020-11-20T11:29:37.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 msgr2=0x7f0a74062870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0a70009fd0 tx=0x7f0a70015000).stop 2020-11-20T11:29:37.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 shutdown_connections 2020-11-20T11:29:37.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a741518e0 0x7f0a74150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740bfd60 0x7f0a7408ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0a4c080630 0x7f0a4c082af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 --2- 172.21.15.105:0/452234854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a7414dbc0 0x7f0a74062870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 >> 172.21.15.105:0/452234854 conn(0x7f0a740b9910 msgr2=0x7f0a740c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 shutdown_connections 2020-11-20T11:29:37.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.697+0000 7f0a7beb5700 1 -- 172.21.15.105:0/452234854 wait complete. 2020-11-20T11:29:37.712 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T11:29:37.713 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:37.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.828+0000 7fb68a1e0700 1 Processor -- start 2020-11-20T11:29:37.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.828+0000 7fb68a1e0700 1 -- start start 2020-11-20T11:29:37.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb68a1e0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb684151c50 0x7fb684063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb68a1e0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb68414b1c0 0x7fb68414b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb68a1e0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68414bad0 con 0x7fb684151870 2020-11-20T11:29:37.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb68a1e0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840641a0 con 0x7fb684151c50 2020-11-20T11:29:37.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb68a1e0700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684067320 con 0x7fb68414b1c0 2020-11-20T11:29:37.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb683fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb68414b1c0 0x7fb68414b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb683fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb68414b1c0 0x7fb68414b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59738/0 (socket says 172.21.15.105:59738) 2020-11-20T11:29:37.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb683fff700 1 -- 172.21.15.105:0/1611016542 learned_addr learned my addr 172.21.15.105:0/1611016542 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:37.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.829+0000 7fb67bfff700 1 --2- 172.21.15.105:0/1611016542 >> v2:172.21.15.67:3300/0 conn(0x7fb684151c50 0x7fb684063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb683fff700 1 -- 172.21.15.105:0/1611016542 >> v2:172.21.15.67:3300/0 conn(0x7fb684151c50 msgr2=0x7fb684063cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:37.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb683fff700 1 --2- 172.21.15.105:0/1611016542 >> v2:172.21.15.67:3300/0 conn(0x7fb684151c50 0x7fb684063cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb683fff700 1 -- 172.21.15.105:0/1611016542 >> v1:172.21.15.67:6789/0 conn(0x7fb684151870 legacy=0x7fb6840667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb682ffd700 1 -- 172.21.15.105:0/1611016542 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923627853 0 0) 0x7fb68414bad0 con 0x7fb684151870 2020-11-20T11:29:37.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb683fff700 1 -- 172.21.15.105:0/1611016542 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840675c0 con 0x7fb68414b1c0 2020-11-20T11:29:37.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb683fff700 1 --2- 172.21.15.105:0/1611016542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb68414b1c0 0x7fb68414b5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb6840c44a0 tx=0x7fb67c009290).ready entity=mon.1 client_cookie=6bfddd539fa56ba7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb682ffd700 1 -- 172.21.15.105:0/1611016542 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00bc50 con 0x7fb68414b1c0 2020-11-20T11:29:37.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb682ffd700 1 -- 172.21.15.105:0/1611016542 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00bdb0 con 0x7fb68414b1c0 2020-11-20T11:29:37.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.830+0000 7fb682ffd700 1 -- 172.21.15.105:0/1611016542 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011610 con 0x7fb68414b1c0 2020-11-20T11:29:37.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1611016542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb68414b1c0 msgr2=0x7fb68414b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1611016542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb68414b1c0 0x7fb68414b5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb6840c44a0 tx=0x7fb67c009290).stop 2020-11-20T11:29:37.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1611016542 shutdown_connections 2020-11-20T11:29:37.839 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1611016542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb68414b1c0 0x7fb68414b5e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1611016542 >> v2:172.21.15.67:3300/0 conn(0x7fb684151c50 0x7fb684063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1611016542 >> 172.21.15.105:0/1611016542 conn(0x7fb6840c4500 msgr2=0x7fb6840c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:37.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1611016542 shutdown_connections 2020-11-20T11:29:37.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.831+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1611016542 wait complete. 2020-11-20T11:29:37.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 Processor -- start 2020-11-20T11:29:37.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 -- start start 2020-11-20T11:29:37.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684151870 0x7fb6840bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb684151c50 0x7fb68414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414d530 con 0x7fb684151c50 2020-11-20T11:29:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414cff0 con 0x7fb684151870 2020-11-20T11:29:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb68a1e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414d290 con 0x7fb68414b1c0 2020-11-20T11:29:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb6837fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.832+0000 7fb6837fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41614/0 (socket says 172.21.15.105:41614) 2020-11-20T11:29:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 -- 172.21.15.105:0/1601606945 learned_addr learned my addr 172.21.15.105:0/1601606945 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb683fff700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb684151c50 0x7fb68414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb67bfff700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684151870 0x7fb6840bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 -- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684151870 msgr2=0x7fb6840bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684151870 0x7fb6840bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 -- 172.21.15.105:0/1601606945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb684151c50 msgr2=0x7fb68414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:37.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb684151c50 0x7fb68414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:37.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 -- 172.21.15.105:0/1601606945 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68414db10 con 0x7fb68414b1c0 2020-11-20T11:29:37.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb6837fe700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb674007fd0 tx=0x7fb674007ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400e560 con 0x7fb68414b1c0 2020-11-20T11:29:37.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67400e6e0 con 0x7fb68414b1c0 2020-11-20T11:29:37.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400eaa0 con 0x7fb68414b1c0 2020-11-20T11:29:37.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68414ddb0 con 0x7fb68414b1c0 2020-11-20T11:29:37.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.833+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840bdd00 con 0x7fb68414b1c0 2020-11-20T11:29:37.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.834+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840bb3c0 con 0x7fb68414b1c0 2020-11-20T11:29:37.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.834+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb674019030 con 0x7fb68414b1c0 2020-11-20T11:29:37.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.835+0000 7fb67b7fe700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 0x7fb660082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:37.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.835+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb6740a1e80 con 0x7fb68414b1c0 2020-11-20T11:29:37.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.835+0000 7fb67bfff700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 0x7fb660082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:37.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.835+0000 7fb67bfff700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 0x7fb660082af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb6840be0e0 tx=0x7fb66c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:37.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:37.838+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb674076890 con 0x7fb68414b1c0 2020-11-20T11:29:38.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.001+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb684044f60 con 0x7fb68414b1c0 2020-11-20T11:29:38.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.002+0000 7fb67b7fe700 1 -- 172.21.15.105:0/1601606945 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fb674079eb0 con 0x7fb68414b1c0 2020-11-20T11:29:38.006 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:38.006 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:38.007 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 msgr2=0x7fb660082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 0x7fb660082af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb6840be0e0 tx=0x7fb66c008040).stop 2020-11-20T11:29:38.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 msgr2=0x7fb68415e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb674007fd0 tx=0x7fb674007ac0).stop 2020-11-20T11:29:38.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 shutdown_connections 2020-11-20T11:29:38.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb684151c50 0x7fb68414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb660080630 0x7fb660082af0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68414b1c0 0x7fb68415e4a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 --2- 172.21.15.105:0/1601606945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684151870 0x7fb6840bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 >> 172.21.15.105:0/1601606945 conn(0x7fb6840c4500 msgr2=0x7fb6840c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 shutdown_connections 2020-11-20T11:29:38.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.004+0000 7fb68a1e0700 1 -- 172.21.15.105:0/1601606945 wait complete. 2020-11-20T11:29:38.018 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T11:29:38.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.133+0000 7f9c9b1c2700 1 Processor -- start 2020-11-20T11:29:38.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.133+0000 7f9c9b1c2700 1 -- start start 2020-11-20T11:29:38.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c9b1c2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c94154e10 0x7f9c94158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c9b1c2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c941592b0 con 0x7f9c941551f0 2020-11-20T11:29:38.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c9b1c2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c94159550 con 0x7f9c940667b0 2020-11-20T11:29:38.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c9b1c2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c941597f0 con 0x7f9c94154e10 2020-11-20T11:29:38.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c93fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9c940667b0 0x7f9c94155e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41228/0 (socket says 172.21.15.105:41228) 2020-11-20T11:29:38.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c93fff700 1 -- 172.21.15.105:0/354106449 learned_addr learned my addr 172.21.15.105:0/354106449 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:38.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138900226 0 0) 0x7f9c94159550 con 0x7f9c940667b0 2020-11-20T11:29:38.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c78003240 con 0x7f9c940667b0 2020-11-20T11:29:38.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/354106449 >> v2:172.21.15.100:3300/0 conn(0x7f9c94154e10 0x7f9c94158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3440806463 0 0) 0x7f9c78003240 con 0x7f9c940667b0 2020-11-20T11:29:38.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 >> v2:172.21.15.100:3300/0 conn(0x7f9c94154e10 msgr2=0x7f9c94158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 --2- 172.21.15.105:0/354106449 >> v2:172.21.15.100:3300/0 conn(0x7f9c94154e10 0x7f9c94158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 >> v1:172.21.15.100:6789/0 conn(0x7f9c941551f0 legacy=0x7f9c9409b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94159a90 con 0x7f9c940667b0 2020-11-20T11:29:38.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f9c800014e0 con 0x7f9c940667b0 2020-11-20T11:29:38.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 >> v1:172.21.15.105:6789/0 conn(0x7f9c940667b0 legacy=0x7f9c94155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 0x7f9c78003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c780044e0 0x7f9c78004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c78004e50 0x7f9c7800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941597f0 con 0x7f9c780044e0 2020-11-20T11:29:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78005300 con 0x7f9c78004e50 2020-11-20T11:29:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.134+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7800bc20 con 0x7f9c78003780 2020-11-20T11:29:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 0x7f9c78003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9975f700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c78004e50 0x7f9c7800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 -- 172.21.15.105:0/354106449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c78004e50 msgr2=0x7f9c7800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c78004e50 0x7f9c7800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 -- 172.21.15.105:0/354106449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c780044e0 msgr2=0x7f9c78004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c780044e0 0x7f9c78004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 -- 172.21.15.105:0/354106449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78003240 con 0x7f9c78003780 2020-11-20T11:29:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9975f700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c78004e50 0x7f9c7800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:38.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9975f700 1 -- 172.21.15.105:0/354106449 reap_dead start 2020-11-20T11:29:38.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 0x7f9c78003ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9c8800bc00 tx=0x7f9c88006df0).ready entity=mon.2 client_cookie=cdf1772917c9d096 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800b310 con 0x7f9c78003780 2020-11-20T11:29:38.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800eb40 con 0x7f9c78003780 2020-11-20T11:29:38.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c937fe700 1 -- 172.21.15.105:0/354106449 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800eec0 con 0x7f9c78003780 2020-11-20T11:29:38.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 msgr2=0x7f9c78003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9b1c2700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 0x7f9c78003ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9c8800bc00 tx=0x7f9c88006df0).stop 2020-11-20T11:29:38.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/354106449 shutdown_connections 2020-11-20T11:29:38.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9b1c2700 1 --2- 172.21.15.105:0/354106449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c78003780 0x7f9c78003ba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.135+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/354106449 >> 172.21.15.105:0/354106449 conn(0x7f9c940b9910 msgr2=0x7f9c940b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.136+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/354106449 shutdown_connections 2020-11-20T11:29:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.136+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/354106449 wait complete. 2020-11-20T11:29:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 Processor -- start 2020-11-20T11:29:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 -- start start 2020-11-20T11:29:38.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c78003780 0x7f9c9414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 0x7f9c940ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9415b140 0x7f9c94146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9414b680 con 0x7f9c78003780 2020-11-20T11:29:38.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9414b8e0 con 0x7f9c9415b140 2020-11-20T11:29:38.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.137+0000 7f9c9b1c2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9414bb80 con 0x7f9c940bf660 2020-11-20T11:29:38.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 0x7f9c940ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 0x7f9c940ba770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41636/0 (socket says 172.21.15.105:41636) 2020-11-20T11:29:38.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 -- 172.21.15.105:0/2256567139 learned_addr learned my addr 172.21.15.105:0/2256567139 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c9975f700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9415b140 0x7f9c94146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c78003780 0x7f9c9414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 -- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9415b140 msgr2=0x7f9c94146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9415b140 0x7f9c94146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 -- 172.21.15.105:0/2256567139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c78003780 msgr2=0x7f9c9414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c78003780 0x7f9c9414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9414be20 con 0x7f9c940bf660 2020-11-20T11:29:38.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c78003780 0x7f9c9414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:38.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c9975f700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9415b140 0x7f9c94146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:38.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c93fff700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 0x7f9c940ba770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f9c8000ca90 tx=0x7f9c80001b40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80007170 con 0x7f9c940bf660 2020-11-20T11:29:38.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c800072f0 con 0x7f9c940bf660 2020-11-20T11:29:38.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9414c0c0 con 0x7f9c940bf660 2020-11-20T11:29:38.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000ab10 con 0x7f9c940bf660 2020-11-20T11:29:38.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.138+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c940bac60 con 0x7f9c940bf660 2020-11-20T11:29:38.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.139+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c94044f60 con 0x7f9c940bf660 2020-11-20T11:29:38.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9c8001b060 con 0x7f9c940bf660 2020-11-20T11:29:38.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9c6c080630 0x7f9c6c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9c800a25b0 con 0x7f9c940bf660 2020-11-20T11:29:38.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f9c6c089360 0x7f9c6c08b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c6c08bde0 con 0x7f9c6c089360 2020-11-20T11:29:38.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c800a4b90 con 0x7f9c940bf660 2020-11-20T11:29:38.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9c6c080630 0x7f9c6c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.140+0000 7f9c9975f700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f9c6c089360 0x7f9c6c08b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.141+0000 7f9c98f5e700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9c6c080630 0x7f9c6c082af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9c88006bd0 tx=0x7f9c88019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.141+0000 7f9c9975f700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f9c6c089360 0x7f9c6c08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.141+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== osd.0 v2:172.21.15.105:6800/24840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9c6c08bde0 con 0x7f9c6c089360 2020-11-20T11:29:38.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.157+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 --> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c941524e0 con 0x7f9c6c089360 2020-11-20T11:29:38.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.157+0000 7f9c90ff9700 1 -- 172.21.15.105:0/2256567139 <== osd.0 v2:172.21.15.105:6800/24840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c941524e0 con 0x7f9c6c089360 2020-11-20T11:29:38.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f9c6c089360 msgr2=0x7f9c6c08b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f9c6c089360 0x7f9c6c08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9c6c080630 msgr2=0x7f9c6c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9c6c080630 0x7f9c6c082af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9c88006bd0 tx=0x7f9c88019000).stop 2020-11-20T11:29:38.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 msgr2=0x7f9c940ba770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 --2- 172.21.15.105:0/2256567139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c940bf660 0x7f9c940ba770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f9c8000ca90 tx=0x7f9c80001b40).stop 2020-11-20T11:29:38.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9975f700 1 -- 172.21.15.105:0/2256567139 reap_dead start 2020-11-20T11:29:38.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 shutdown_connections 2020-11-20T11:29:38.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 >> 172.21.15.105:0/2256567139 conn(0x7f9c940b9910 msgr2=0x7f9c94153170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 shutdown_connections 2020-11-20T11:29:38.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.158+0000 7f9c9b1c2700 1 -- 172.21.15.105:0/2256567139 wait complete. 2020-11-20T11:29:38.172 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:38.172 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T11:29:38.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 Processor -- start 2020-11-20T11:29:38.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 -- start start 2020-11-20T11:29:38.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f11e00c37e0 0x7f11e00c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e014e210 con 0x7f11e014af60 2020-11-20T11:29:38.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e014e4b0 con 0x7f11e00bfdd0 2020-11-20T11:29:38.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.290+0000 7f11e66ad700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e014e750 con 0x7f11e00c37e0 2020-11-20T11:29:38.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11e4c4a700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f11e00bfdd0 0x7f11e00c0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41252/0 (socket says 172.21.15.105:41252) 2020-11-20T11:29:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11e4c4a700 1 -- 172.21.15.105:0/2510197867 learned_addr learned my addr 172.21.15.105:0/2510197867 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11dffff700 1 --2- 172.21.15.105:0/2510197867 >> v2:172.21.15.100:3300/0 conn(0x7f11e00c37e0 0x7f11e00c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11deffd700 1 -- 172.21.15.105:0/2510197867 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715385855 0 0) 0x7f11e014e4b0 con 0x7f11e00bfdd0 2020-11-20T11:29:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11deffd700 1 -- 172.21.15.105:0/2510197867 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11cc003240 con 0x7f11e00bfdd0 2020-11-20T11:29:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11dffff700 1 -- 172.21.15.105:0/2510197867 >> v1:172.21.15.105:6789/0 conn(0x7f11e00bfdd0 legacy=0x7f11e00c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11dffff700 1 -- 172.21.15.105:0/2510197867 >> v1:172.21.15.100:6789/0 conn(0x7f11e014af60 legacy=0x7f11e014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11dffff700 1 -- 172.21.15.105:0/2510197867 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e014e9f0 con 0x7f11e00c37e0 2020-11-20T11:29:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11dffff700 1 --2- 172.21.15.105:0/2510197867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e00c3bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11d000b9a0 tx=0x7f11d0006df0).ready entity=mon.1 client_cookie=edbdd65b5d948ef3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11deffd700 1 -- 172.21.15.105:0/2510197867 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d00097b0 con 0x7f11e00c37e0 2020-11-20T11:29:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11deffd700 1 -- 172.21.15.105:0/2510197867 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0009910 con 0x7f11e00c37e0 2020-11-20T11:29:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.291+0000 7f11deffd700 1 -- 172.21.15.105:0/2510197867 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0009c90 con 0x7f11e00c37e0 2020-11-20T11:29:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 -- 172.21.15.105:0/2510197867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 msgr2=0x7f11e00c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 --2- 172.21.15.105:0/2510197867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e00c3bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11d000b9a0 tx=0x7f11d0006df0).stop 2020-11-20T11:29:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 -- 172.21.15.105:0/2510197867 shutdown_connections 2020-11-20T11:29:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 --2- 172.21.15.105:0/2510197867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e00c3bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 -- 172.21.15.105:0/2510197867 >> 172.21.15.105:0/2510197867 conn(0x7f11e00b9910 msgr2=0x7f11e00b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 -- 172.21.15.105:0/2510197867 shutdown_connections 2020-11-20T11:29:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.292+0000 7f11e66ad700 1 -- 172.21.15.105:0/2510197867 wait complete. 2020-11-20T11:29:38.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.293+0000 7f11e66ad700 1 Processor -- start 2020-11-20T11:29:38.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.293+0000 7f11e66ad700 1 -- start start 2020-11-20T11:29:38.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00bfdd0 0x7f11e01618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e0146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 0x7f11e015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e015e390 con 0x7f11e00bfdd0 2020-11-20T11:29:38.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0153c10 con 0x7f11e00c37e0 2020-11-20T11:29:38.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e66ad700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0153e70 con 0x7f11e014af60 2020-11-20T11:29:38.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 0x7f11e015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 0x7f11e015ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41654/0 (socket says 172.21.15.105:41654) 2020-11-20T11:29:38.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 -- 172.21.15.105:0/1720143428 learned_addr learned my addr 172.21.15.105:0/1720143428 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11df7fe700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e0146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11dffff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00bfdd0 0x7f11e01618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 -- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 msgr2=0x7f11e0146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11e00c37e0 0x7f11e0146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 -- 172.21.15.105:0/1720143428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00bfdd0 msgr2=0x7f11e01618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00bfdd0 0x7f11e01618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.308 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0161dc0 con 0x7f11e014af60 2020-11-20T11:29:38.308 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11dffff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00bfdd0 0x7f11e01618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:38.308 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11e4c4a700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 0x7f11e015ecc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f11d8001420 tx=0x7f11d8007e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.308 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8005b80 con 0x7f11e014af60 2020-11-20T11:29:38.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.294+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8005ce0 con 0x7f11e014af60 2020-11-20T11:29:38.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.295+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e0146d60 con 0x7f11e014af60 2020-11-20T11:29:38.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.295+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8007320 con 0x7f11e014af60 2020-11-20T11:29:38.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.295+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e0154370 con 0x7f11e014af60 2020-11-20T11:29:38.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.296+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11e014de70 con 0x7f11e014af60 2020-11-20T11:29:38.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.296+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f11d8010030 con 0x7f11e014af60 2020-11-20T11:29:38.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11c7fff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11bc080630 0x7f11bc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f11d80a2990 con 0x7f11e014af60 2020-11-20T11:29:38.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11dffff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11bc080630 0x7f11bc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11c7fff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f11bc089360 0x7f11bc08b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11bc08bde0 con 0x7f11bc089360 2020-11-20T11:29:38.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d80a7220 con 0x7f11e014af60 2020-11-20T11:29:38.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11df7fe700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f11bc089360 0x7f11bc08b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11dffff700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11bc080630 0x7f11bc082af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f11d0006e30 tx=0x7f11d0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.297+0000 7f11df7fe700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f11bc089360 0x7f11bc08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.299+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== osd.1 v2:172.21.15.100:6802/24705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f11bc08bde0 con 0x7f11bc089360 2020-11-20T11:29:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.315+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 --> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11e0044f60 con 0x7f11bc089360 2020-11-20T11:29:38.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.315+0000 7f11c7fff700 1 -- 172.21.15.105:0/1720143428 <== osd.1 v2:172.21.15.100:6802/24705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11e0044f60 con 0x7f11bc089360 2020-11-20T11:29:38.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f11bc089360 msgr2=0x7f11bc08b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f11bc089360 0x7f11bc08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11bc080630 msgr2=0x7f11bc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11bc080630 0x7f11bc082af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f11d0006e30 tx=0x7f11d0015000).stop 2020-11-20T11:29:38.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 msgr2=0x7f11e015ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 --2- 172.21.15.105:0/1720143428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11e014af60 0x7f11e015ecc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f11d8001420 tx=0x7f11d8007e20).stop 2020-11-20T11:29:38.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e4c4a700 1 -- 172.21.15.105:0/1720143428 reap_dead start 2020-11-20T11:29:38.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 shutdown_connections 2020-11-20T11:29:38.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 >> 172.21.15.105:0/1720143428 conn(0x7f11e00b9910 msgr2=0x7f11e014d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 shutdown_connections 2020-11-20T11:29:38.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.316+0000 7f11e66ad700 1 -- 172.21.15.105:0/1720143428 wait complete. 2020-11-20T11:29:38.330 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:38.330 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T11:29:38.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.455+0000 7f9be5237700 1 Processor -- start 2020-11-20T11:29:38.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.455+0000 7f9be5237700 1 -- start start 2020-11-20T11:29:38.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9be5237700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9be00be480 0x7f9be01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9be5237700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00be8c0 con 0x7f9be00c3f70 2020-11-20T11:29:38.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9be5237700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00651e0 con 0x7f9be0066970 2020-11-20T11:29:38.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9be5237700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0065480 con 0x7f9be00be480 2020-11-20T11:29:38.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9bded9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9be0066970 0x7f9be0066d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41264/0 (socket says 172.21.15.105:41264) 2020-11-20T11:29:38.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9bded9d700 1 -- 172.21.15.105:0/1367771033 learned_addr learned my addr 172.21.15.105:0/1367771033 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:38.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984953723 0 0) 0x7f9be00651e0 con 0x7f9be0066970 2020-11-20T11:29:38.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.456+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc003240 con 0x7f9be0066970 2020-11-20T11:29:38.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/1367771033 >> v2:172.21.15.100:3300/0 conn(0x7f9be00be480 0x7f9be01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3170241618 0 0) 0x7f9bcc003240 con 0x7f9be0066970 2020-11-20T11:29:38.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 >> v2:172.21.15.100:3300/0 conn(0x7f9be00be480 msgr2=0x7f9be01587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 --2- 172.21.15.105:0/1367771033 >> v2:172.21.15.100:3300/0 conn(0x7f9be00be480 0x7f9be01587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 >> v1:172.21.15.100:6789/0 conn(0x7f9be00c3f70 legacy=0x7f9be00bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0065720 con 0x7f9be0066970 2020-11-20T11:29:38.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f9bd40014e0 con 0x7f9be0066970 2020-11-20T11:29:38.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 >> v1:172.21.15.105:6789/0 conn(0x7f9be0066970 legacy=0x7f9be0066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc003780 0x7f9bcc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bcc0044e0 0x7f9bcc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 0x7f9bcc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0065480 con 0x7f9bcc003780 2020-11-20T11:29:38.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc005300 con 0x7f9bcc0044e0 2020-11-20T11:29:38.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc00bc20 con 0x7f9bcc004e50 2020-11-20T11:29:38.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 0x7f9bcc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bde59c700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bcc0044e0 0x7f9bcc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bded9d700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc003780 0x7f9bcc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 -- 172.21.15.105:0/1367771033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bcc0044e0 msgr2=0x7f9bcc004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bcc0044e0 0x7f9bcc004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 -- 172.21.15.105:0/1367771033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc003780 msgr2=0x7f9bcc003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc003780 0x7f9bcc003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 -- 172.21.15.105:0/1367771033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc003240 con 0x7f9bcc004e50 2020-11-20T11:29:38.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 -- 172.21.15.105:0/1367771033 reap_dead start 2020-11-20T11:29:38.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 0x7f9bcc00b730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9bd8009ea0 tx=0x7f9bd80091d0).ready entity=mon.2 client_cookie=f413df93b92b2948 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80095c0 con 0x7f9bcc004e50 2020-11-20T11:29:38.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800ecf0 con 0x7f9bcc004e50 2020-11-20T11:29:38.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.457+0000 7f9bddd9b700 1 -- 172.21.15.105:0/1367771033 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8012640 con 0x7f9bcc004e50 2020-11-20T11:29:38.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 -- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 msgr2=0x7f9bcc00b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 0x7f9bcc00b730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9bd8009ea0 tx=0x7f9bd80091d0).stop 2020-11-20T11:29:38.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 -- 172.21.15.105:0/1367771033 shutdown_connections 2020-11-20T11:29:38.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 --2- 172.21.15.105:0/1367771033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bcc004e50 0x7f9bcc00b730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 -- 172.21.15.105:0/1367771033 >> 172.21.15.105:0/1367771033 conn(0x7f9be00264f0 msgr2=0x7f9be00c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 -- 172.21.15.105:0/1367771033 shutdown_connections 2020-11-20T11:29:38.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.458+0000 7f9be5237700 1 -- 172.21.15.105:0/1367771033 wait complete. 2020-11-20T11:29:38.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.459+0000 7f9be5237700 1 Processor -- start 2020-11-20T11:29:38.472 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.459+0000 7f9be5237700 1 -- start start 2020-11-20T11:29:38.474 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc004e50 0x7f9be01604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.474 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00c38a0 0x7f9be00bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.475 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 0x7f9be0148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.475 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0160990 con 0x7f9bcc004e50 2020-11-20T11:29:38.475 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0090630 con 0x7f9be00c38a0 2020-11-20T11:29:38.475 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9be5237700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00900f0 con 0x7f9be00bb9d0 2020-11-20T11:29:38.475 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 0x7f9be0148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 0x7f9be0148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41674/0 (socket says 172.21.15.105:41674) 2020-11-20T11:29:38.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 -- 172.21.15.105:0/3222350570 learned_addr learned my addr 172.21.15.105:0/3222350570 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bded9d700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc004e50 0x7f9be01604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bde59c700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00c38a0 0x7f9be00bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 -- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00c38a0 msgr2=0x7f9be00bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00c38a0 0x7f9be00bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 -- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc004e50 msgr2=0x7f9be01604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc004e50 0x7f9be01604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0090390 con 0x7f9be00bb9d0 2020-11-20T11:29:38.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bdf59e700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 0x7f9be0148a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9be00645a0 tx=0x7f9bd8019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.460+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800ee60 con 0x7f9be00bb9d0 2020-11-20T11:29:38.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.461+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd801c650 con 0x7f9be00bb9d0 2020-11-20T11:29:38.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.461+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be015dae0 con 0x7f9be00bb9d0 2020-11-20T11:29:38.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.461+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd801c9d0 con 0x7f9be00bb9d0 2020-11-20T11:29:38.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.461+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be015e020 con 0x7f9be00bb9d0 2020-11-20T11:29:38.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.461+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9be005ca10 con 0x7f9be00bb9d0 2020-11-20T11:29:38.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.462+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9bd802c070 con 0x7f9be00bb9d0 2020-11-20T11:29:38.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bc6ffd700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9bbc080630 0x7f9bbc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9bd80a5340 con 0x7f9be00bb9d0 2020-11-20T11:29:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bc6ffd700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f9bbc089360 0x7f9bbc08b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bded9d700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9bbc080630 0x7f9bbc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bbc08bde0 con 0x7f9bbc089360 2020-11-20T11:29:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bd80a56b0 con 0x7f9be00bb9d0 2020-11-20T11:29:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bde59c700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f9bbc089360 0x7f9bbc08b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.481 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bded9d700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9bbc080630 0x7f9bbc082af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9bd40013b0 tx=0x7f9bd4007040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.481 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.463+0000 7f9bde59c700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f9bbc089360 0x7f9bbc08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.481 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.464+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== osd.2 v2:172.21.15.67:6824/25159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9bbc08bde0 con 0x7f9bbc089360 2020-11-20T11:29:38.483 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.480+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 --> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9be015e1e0 con 0x7f9bbc089360 2020-11-20T11:29:38.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.481+0000 7f9bc6ffd700 1 -- 172.21.15.105:0/3222350570 <== osd.2 v2:172.21.15.67:6824/25159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9be015e1e0 con 0x7f9bbc089360 2020-11-20T11:29:38.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.481+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f9bbc089360 msgr2=0x7f9bbc08b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.481+0000 7f9be5237700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f9bbc089360 0x7f9bbc08b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9bbc080630 msgr2=0x7f9bbc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9bbc080630 0x7f9bbc082af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9bd40013b0 tx=0x7f9bd4007040).stop 2020-11-20T11:29:38.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 msgr2=0x7f9be0148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 --2- 172.21.15.105:0/3222350570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be00bb9d0 0x7f9be0148a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9be00645a0 tx=0x7f9bd8019000).stop 2020-11-20T11:29:38.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9bdf59e700 1 -- 172.21.15.105:0/3222350570 reap_dead start 2020-11-20T11:29:38.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 shutdown_connections 2020-11-20T11:29:38.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 >> 172.21.15.105:0/3222350570 conn(0x7f9be00264f0 msgr2=0x7f9be00bdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 shutdown_connections 2020-11-20T11:29:38.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.482+0000 7f9be5237700 1 -- 172.21.15.105:0/3222350570 wait complete. 2020-11-20T11:29:38.496 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:38.496 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T11:29:38.642 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.639+0000 7fe72d2b5700 1 Processor -- start 2020-11-20T11:29:38.643 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.639+0000 7fe72d2b5700 1 -- start start 2020-11-20T11:29:38.645 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe72d2b5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe728150530 0x7fe72809d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.645 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe72d2b5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728152cf0 con 0x7fe72809cd80 2020-11-20T11:29:38.646 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe72d2b5700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728152f90 con 0x7fe72809b0e0 2020-11-20T11:29:38.646 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe72d2b5700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe728153230 con 0x7fe728150530 2020-11-20T11:29:38.646 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe726ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe72809cd80 0x7fe72814f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:52746/0 (socket says 172.21.15.105:52746) 2020-11-20T11:29:38.647 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe726ffd700 1 -- 172.21.15.105:0/3803402336 learned_addr learned my addr 172.21.15.105:0/3803402336 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:38.647 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe7267fc700 1 --2- 172.21.15.105:0/3803402336 >> v2:172.21.15.100:3300/0 conn(0x7fe728150530 0x7fe72809d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe725ffb700 1 -- 172.21.15.105:0/3803402336 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362616054 0 0) 0x7fe728152cf0 con 0x7fe72809cd80 2020-11-20T11:29:38.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.640+0000 7fe725ffb700 1 -- 172.21.15.105:0/3803402336 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe714003240 con 0x7fe72809cd80 2020-11-20T11:29:38.650 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe7267fc700 1 -- 172.21.15.105:0/3803402336 >> v1:172.21.15.100:6789/0 conn(0x7fe72809b0e0 legacy=0x7fe72814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe7267fc700 1 -- 172.21.15.105:0/3803402336 >> v1:172.21.15.67:6789/0 conn(0x7fe72809cd80 legacy=0x7fe72814f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe7267fc700 1 -- 172.21.15.105:0/3803402336 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7281534d0 con 0x7fe728150530 2020-11-20T11:29:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe7267fc700 1 --2- 172.21.15.105:0/3803402336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe728150530 0x7fe72809d160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe71800b9a0 tx=0x7fe718006df0).ready entity=mon.1 client_cookie=196836352bdd67ae server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe725ffb700 1 -- 172.21.15.105:0/3803402336 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718009840 con 0x7fe728150530 2020-11-20T11:29:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe725ffb700 1 -- 172.21.15.105:0/3803402336 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180099a0 con 0x7fe728150530 2020-11-20T11:29:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe725ffb700 1 -- 172.21.15.105:0/3803402336 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718009d20 con 0x7fe728150530 2020-11-20T11:29:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 -- 172.21.15.105:0/3803402336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe728150530 msgr2=0x7fe72809d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 --2- 172.21.15.105:0/3803402336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe728150530 0x7fe72809d160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe71800b9a0 tx=0x7fe718006df0).stop 2020-11-20T11:29:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 -- 172.21.15.105:0/3803402336 shutdown_connections 2020-11-20T11:29:38.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 --2- 172.21.15.105:0/3803402336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe728150530 0x7fe72809d160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 -- 172.21.15.105:0/3803402336 >> 172.21.15.105:0/3803402336 conn(0x7fe728025a60 msgr2=0x7fe728025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 -- 172.21.15.105:0/3803402336 shutdown_connections 2020-11-20T11:29:38.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.641+0000 7fe72d2b5700 1 -- 172.21.15.105:0/3803402336 wait complete. 2020-11-20T11:29:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 Processor -- start 2020-11-20T11:29:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 -- start start 2020-11-20T11:29:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe72809b0e0 0x7fe728161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe72809cd80 0x7fe7280c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 0x7fe728147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c5180 con 0x7fe72809cd80 2020-11-20T11:29:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728161300 con 0x7fe72809b0e0 2020-11-20T11:29:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe72d2b5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280c4c40 con 0x7fe728150530 2020-11-20T11:29:38.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe7277fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 0x7fe728147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe7277fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 0x7fe728147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41688/0 (socket says 172.21.15.105:41688) 2020-11-20T11:29:38.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.643+0000 7fe7277fe700 1 -- 172.21.15.105:0/1043203423 learned_addr learned my addr 172.21.15.105:0/1043203423 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe726ffd700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe72809b0e0 0x7fe728161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7267fc700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe72809cd80 0x7fe7280c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 -- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe72809b0e0 msgr2=0x7fe728161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe72809b0e0 0x7fe728161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 -- 172.21.15.105:0/1043203423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe72809cd80 msgr2=0x7fe7280c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe72809cd80 0x7fe7280c0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280c4ee0 con 0x7fe728150530 2020-11-20T11:29:38.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe7277fe700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 0x7fe728147b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe72000ca90 tx=0x7fe720007f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000a730 con 0x7fe728150530 2020-11-20T11:29:38.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000a890 con 0x7fe728150530 2020-11-20T11:29:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280c0460 con 0x7fe728150530 2020-11-20T11:29:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000ac10 con 0x7fe728150530 2020-11-20T11:29:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.644+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728160ef0 con 0x7fe728150530 2020-11-20T11:29:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.645+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7280c02e0 con 0x7fe728150530 2020-11-20T11:29:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe720019030 con 0x7fe728150530 2020-11-20T11:29:38.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fe704080630 0x7fe704082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe7200a21d0 con 0x7fe728150530 2020-11-20T11:29:38.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fe704089360 0x7fe70408b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe726ffd700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fe704080630 0x7fe704082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe70408bde0 con 0x7fe704089360 2020-11-20T11:29:38.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7200a47b0 con 0x7fe728150530 2020-11-20T11:29:38.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.646+0000 7fe7267fc700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fe704089360 0x7fe70408b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.647+0000 7fe726ffd700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fe704080630 0x7fe704082af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe71c0055a0 tx=0x7fe71c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.647+0000 7fe7267fc700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fe704089360 0x7fe70408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.647+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== osd.3 v2:172.21.15.105:6808/24841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fe70408bde0 con 0x7fe704089360 2020-11-20T11:29:38.667 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 --> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7280c2a30 con 0x7fe704089360 2020-11-20T11:29:38.668 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe70effd700 1 -- 172.21.15.105:0/1043203423 <== osd.3 v2:172.21.15.105:6808/24841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7280c2a30 con 0x7fe704089360 2020-11-20T11:29:38.669 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fe704089360 msgr2=0x7fe70408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.669 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fe704089360 0x7fe70408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.669 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fe704080630 msgr2=0x7fe704082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.669 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fe704080630 0x7fe704082af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe71c0055a0 tx=0x7fe71c009040).stop 2020-11-20T11:29:38.670 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 msgr2=0x7fe728147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.670 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 --2- 172.21.15.105:0/1043203423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe728150530 0x7fe728147b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe72000ca90 tx=0x7fe720007f40).stop 2020-11-20T11:29:38.670 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe7277fe700 1 -- 172.21.15.105:0/1043203423 reap_dead start 2020-11-20T11:29:38.670 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 shutdown_connections 2020-11-20T11:29:38.670 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.664+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 >> 172.21.15.105:0/1043203423 conn(0x7fe728025a60 msgr2=0x7fe7281509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.671 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.665+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 shutdown_connections 2020-11-20T11:29:38.671 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.665+0000 7fe72d2b5700 1 -- 172.21.15.105:0/1043203423 wait complete. 2020-11-20T11:29:38.678 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:38.679 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T11:29:38.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.799+0000 7f849da7b700 1 Processor -- start 2020-11-20T11:29:38.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 -- start start 2020-11-20T11:29:38.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 0x7f84980c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f849814e390 0x7f849814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980becf0 con 0x7f84980bdda0 2020-11-20T11:29:38.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84980be270 con 0x7f84980c0060 2020-11-20T11:29:38.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.800+0000 7f849da7b700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84980be510 con 0x7f849814e390 2020-11-20T11:29:38.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f849814e390 0x7f849814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f84977fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 0x7f84980c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f849814e390 0x7f849814cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59826/0 (socket says 172.21.15.105:59826) 2020-11-20T11:29:38.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f84977fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 0x7f84980c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:44990/0 (socket says 172.21.15.105:44990) 2020-11-20T11:29:38.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 -- 172.21.15.105:0/159340026 learned_addr learned my addr 172.21.15.105:0/159340026 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8496ffd700 1 --1- 172.21.15.105:0/159340026 >> v1:172.21.15.67:6789/0 conn(0x7f84980bdda0 0x7f849814dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:52762/0 (socket says 172.21.15.105:52762) 2020-11-20T11:29:38.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 -- 172.21.15.105:0/159340026 >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 msgr2=0x7f84980c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 --2- 172.21.15.105:0/159340026 >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 0x7f84980c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 -- 172.21.15.105:0/159340026 >> v1:172.21.15.67:6789/0 conn(0x7f84980bdda0 legacy=0x7f849814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 -- 172.21.15.105:0/159340026 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980be7b0 con 0x7f849814e390 2020-11-20T11:29:38.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f8497fff700 1 --2- 172.21.15.105:0/159340026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f849814e390 0x7f849814cb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f84980663b0 tx=0x7f849000a430).ready entity=mon.1 client_cookie=fa509e3a9c49c0f4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f84967fc700 1 -- 172.21.15.105:0/159340026 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490010410 con 0x7f849814e390 2020-11-20T11:29:38.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f84967fc700 1 -- 172.21.15.105:0/159340026 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490010570 con 0x7f849814e390 2020-11-20T11:29:38.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.801+0000 7f84967fc700 1 -- 172.21.15.105:0/159340026 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900108f0 con 0x7f849814e390 2020-11-20T11:29:38.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 -- 172.21.15.105:0/159340026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f849814e390 msgr2=0x7f849814cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 --2- 172.21.15.105:0/159340026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f849814e390 0x7f849814cb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f84980663b0 tx=0x7f849000a430).stop 2020-11-20T11:29:38.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 -- 172.21.15.105:0/159340026 shutdown_connections 2020-11-20T11:29:38.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 --2- 172.21.15.105:0/159340026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f849814e390 0x7f849814cb70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 --2- 172.21.15.105:0/159340026 >> v2:172.21.15.67:3300/0 conn(0x7f84980c0060 0x7f84980c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 -- 172.21.15.105:0/159340026 >> 172.21.15.105:0/159340026 conn(0x7f84980b9910 msgr2=0x7f84980b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 -- 172.21.15.105:0/159340026 shutdown_connections 2020-11-20T11:29:38.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.802+0000 7f849da7b700 1 -- 172.21.15.105:0/159340026 wait complete. 2020-11-20T11:29:38.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.803+0000 7f849da7b700 1 Processor -- start 2020-11-20T11:29:38.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.803+0000 7f849da7b700 1 -- start start 2020-11-20T11:29:38.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 0x7f849815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84980c0060 0x7f8498137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f849814e390 0x7f8498066f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980936e0 con 0x7f849814e390 2020-11-20T11:29:38.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849815d090 con 0x7f84980c0060 2020-11-20T11:29:38.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498138740 con 0x7f84980bdda0 2020-11-20T11:29:38.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 0x7f849815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 0x7f849815cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41700/0 (socket says 172.21.15.105:41700) 2020-11-20T11:29:38.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 -- 172.21.15.105:0/1898047148 learned_addr learned my addr 172.21.15.105:0/1898047148 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f8497fff700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f849814e390 0x7f8498066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f8496ffd700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84980c0060 0x7f8498137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 -- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84980c0060 msgr2=0x7f8498137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84980c0060 0x7f8498137fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 -- 172.21.15.105:0/1898047148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f849814e390 msgr2=0x7f8498066f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f849814e390 0x7f8498066f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84981384c0 con 0x7f84980bdda0 2020-11-20T11:29:38.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f84977fe700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 0x7f849815cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f848800ec30 tx=0x7f8488006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800c880 con 0x7f84980bdda0 2020-11-20T11:29:38.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800c9e0 con 0x7f84980bdda0 2020-11-20T11:29:38.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84980938d0 con 0x7f84980bdda0 2020-11-20T11:29:38.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800cd60 con 0x7f84980bdda0 2020-11-20T11:29:38.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.804+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8498093e10 con 0x7f84980bdda0 2020-11-20T11:29:38.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.805+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8498094010 con 0x7f84980bdda0 2020-11-20T11:29:38.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.806+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8488012600 con 0x7f84980bdda0 2020-11-20T11:29:38.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.806+0000 7f847f7fe700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8474080630 0x7f8474082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.806+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f84880a3770 con 0x7f84980bdda0 2020-11-20T11:29:38.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f847f7fe700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f8474089360 0x7f847408b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f847408bde0 con 0x7f8474089360 2020-11-20T11:29:38.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84880a3ae0 con 0x7f84980bdda0 2020-11-20T11:29:38.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f8496ffd700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8474080630 0x7f8474082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f8497fff700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f8474089360 0x7f847408b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f8496ffd700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8474080630 0x7f8474082af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f849814cc20 tx=0x7f848c007b40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.807+0000 7f8497fff700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f8474089360 0x7f847408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.808+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== osd.4 v2:172.21.15.100:6810/24706 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f847408bde0 con 0x7f8474089360 2020-11-20T11:29:38.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.824+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 --> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8498044f60 con 0x7f8474089360 2020-11-20T11:29:38.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f847f7fe700 1 -- 172.21.15.105:0/1898047148 <== osd.4 v2:172.21.15.100:6810/24706 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8498044f60 con 0x7f8474089360 2020-11-20T11:29:38.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f8474089360 msgr2=0x7f847408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f8474089360 0x7f847408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8474080630 msgr2=0x7f8474082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8474080630 0x7f8474082af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f849814cc20 tx=0x7f848c007b40).stop 2020-11-20T11:29:38.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 msgr2=0x7f849815cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 --2- 172.21.15.105:0/1898047148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84980bdda0 0x7f849815cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f848800ec30 tx=0x7f8488006df0).stop 2020-11-20T11:29:38.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f8497fff700 1 -- 172.21.15.105:0/1898047148 reap_dead start 2020-11-20T11:29:38.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 shutdown_connections 2020-11-20T11:29:38.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 >> 172.21.15.105:0/1898047148 conn(0x7f84980b9910 msgr2=0x7f8498138ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 shutdown_connections 2020-11-20T11:29:38.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.825+0000 7f849da7b700 1 -- 172.21.15.105:0/1898047148 wait complete. 2020-11-20T11:29:38.840 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:38.841 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T11:29:38.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.960+0000 7f4d48e32700 1 Processor -- start 2020-11-20T11:29:38.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.960+0000 7f4d48e32700 1 -- start start 2020-11-20T11:29:38.965 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d48e32700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4d440c37e0 0x7f4d440c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d48e32700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 0x7f4d4414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d48e32700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4414e210 con 0x7f4d440bfdd0 2020-11-20T11:29:38.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d48e32700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4414e4b0 con 0x7f4d4414af60 2020-11-20T11:29:38.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d48e32700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4414e750 con 0x7f4d440c37e0 2020-11-20T11:29:38.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4d440c37e0 0x7f4d440c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4d440c37e0 0x7f4d440c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41710/0 (socket says 172.21.15.105:41710) 2020-11-20T11:29:38.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 -- 172.21.15.105:0/690488667 learned_addr learned my addr 172.21.15.105:0/690488667 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d41d9b700 1 --2- 172.21.15.105:0/690488667 >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 0x7f4d4414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 -- 172.21.15.105:0/690488667 >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 msgr2=0x7f4d4414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 --2- 172.21.15.105:0/690488667 >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 0x7f4d4414b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 -- 172.21.15.105:0/690488667 >> v1:172.21.15.100:6789/0 conn(0x7f4d440bfdd0 legacy=0x7f4d440c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:38.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 -- 172.21.15.105:0/690488667 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4414e9f0 con 0x7f4d440c37e0 2020-11-20T11:29:38.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d41d9b700 1 --2- 172.21.15.105:0/690488667 >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 0x7f4d4414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:38.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4259c700 1 --2- 172.21.15.105:0/690488667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d440c37e0 0x7f4d440c3bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4d44026ab0 tx=0x7f4d3c009290).ready entity=mon.2 client_cookie=df92b5d1337638e1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.969 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4159a700 1 -- 172.21.15.105:0/690488667 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00bb80 con 0x7f4d440c37e0 2020-11-20T11:29:38.969 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4159a700 1 -- 172.21.15.105:0/690488667 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00bce0 con 0x7f4d440c37e0 2020-11-20T11:29:38.969 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.961+0000 7f4d4159a700 1 -- 172.21.15.105:0/690488667 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c011610 con 0x7f4d440c37e0 2020-11-20T11:29:38.969 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 -- 172.21.15.105:0/690488667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d440c37e0 msgr2=0x7f4d440c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.969 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 --2- 172.21.15.105:0/690488667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d440c37e0 0x7f4d440c3bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4d44026ab0 tx=0x7f4d3c009290).stop 2020-11-20T11:29:38.970 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 -- 172.21.15.105:0/690488667 shutdown_connections 2020-11-20T11:29:38.970 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 --2- 172.21.15.105:0/690488667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d440c37e0 0x7f4d440c3bc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.970 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 --2- 172.21.15.105:0/690488667 >> v2:172.21.15.67:3300/0 conn(0x7f4d4414af60 0x7f4d4414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.970 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 -- 172.21.15.105:0/690488667 >> 172.21.15.105:0/690488667 conn(0x7f4d440b9910 msgr2=0x7f4d440b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.970 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 -- 172.21.15.105:0/690488667 shutdown_connections 2020-11-20T11:29:38.971 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.962+0000 7f4d48e32700 1 -- 172.21.15.105:0/690488667 wait complete. 2020-11-20T11:29:38.973 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.963+0000 7f4d48e32700 1 Processor -- start 2020-11-20T11:29:38.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.963+0000 7f4d48e32700 1 -- start start 2020-11-20T11:29:38.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d440bfdd0 0x7f4d441474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d440c37e0 0x7f4d44153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 0x7f4d44065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.974 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441619b0 con 0x7f4d440bfdd0 2020-11-20T11:29:38.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44161c10 con 0x7f4d440c37e0 2020-11-20T11:29:38.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44161eb0 con 0x7f4d4414af60 2020-11-20T11:29:38.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 0x7f4d44065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 0x7f4d44065320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41720/0 (socket says 172.21.15.105:41720) 2020-11-20T11:29:38.975 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 -- 172.21.15.105:0/406611780 learned_addr learned my addr 172.21.15.105:0/406611780 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:38.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d4259c700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d440bfdd0 0x7f4d441474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d41d9b700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d440c37e0 0x7f4d44153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 -- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d440c37e0 msgr2=0x7f4d44153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.976 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d440c37e0 0x7f4d44153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 -- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d440bfdd0 msgr2=0x7f4d441474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d440bfdd0 0x7f4d441474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44162150 con 0x7f4d4414af60 2020-11-20T11:29:38.977 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d4259c700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d440bfdd0 0x7f4d441474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:38.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d42d9d700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 0x7f4d44065320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4d34009690 tx=0x7f4d34006cf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400d560 con 0x7f4d4414af60 2020-11-20T11:29:38.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34000e90 con 0x7f4d4414af60 2020-11-20T11:29:38.978 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d441623f0 con 0x7f4d4414af60 2020-11-20T11:29:38.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400d930 con 0x7f4d4414af60 2020-11-20T11:29:38.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.964+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d44154150 con 0x7f4d4414af60 2020-11-20T11:29:38.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.965+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d44044f60 con 0x7f4d4414af60 2020-11-20T11:29:38.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.966+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4d3400f030 con 0x7f4d4414af60 2020-11-20T11:29:38.979 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.966+0000 7f4d3a7fc700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4d20080660 0x7f4d20082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.980 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.966+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4d340a25c0 con 0x7f4d4414af60 2020-11-20T11:29:38.980 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d3a7fc700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f4d20089390 0x7f4d2008b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:38.980 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d2008be10 con 0x7f4d20089390 2020-11-20T11:29:38.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d340a4b20 con 0x7f4d4414af60 2020-11-20T11:29:38.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d4259c700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4d20080660 0x7f4d20082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d41d9b700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f4d20089390 0x7f4d2008b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:38.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d4259c700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4d20080660 0x7f4d20082b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4d3c0092d0 tx=0x7f4d3c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.981 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.967+0000 7f4d41d9b700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f4d20089390 0x7f4d2008b7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:38.982 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.968+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== osd.5 v2:172.21.15.67:6808/25148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f4d2008be10 con 0x7f4d20089390 2020-11-20T11:29:38.987 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.984+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 --> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d44162580 con 0x7f4d20089390 2020-11-20T11:29:38.988 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d3a7fc700 1 -- 172.21.15.105:0/406611780 <== osd.5 v2:172.21.15.67:6808/25148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d44162580 con 0x7f4d20089390 2020-11-20T11:29:38.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f4d20089390 msgr2=0x7f4d2008b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f4d20089390 0x7f4d2008b7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:38.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4d20080660 msgr2=0x7f4d20082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4d20080660 0x7f4d20082b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4d3c0092d0 tx=0x7f4d3c016000).stop 2020-11-20T11:29:38.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 msgr2=0x7f4d44065320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:38.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d48e32700 1 --2- 172.21.15.105:0/406611780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d4414af60 0x7f4d44065320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4d34009690 tx=0x7f4d34006cf0).stop 2020-11-20T11:29:38.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.985+0000 7f4d42d9d700 1 -- 172.21.15.105:0/406611780 reap_dead start 2020-11-20T11:29:38.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.986+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 shutdown_connections 2020-11-20T11:29:38.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.986+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 >> 172.21.15.105:0/406611780 conn(0x7f4d440b9910 msgr2=0x7f4d440c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:38.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.986+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 shutdown_connections 2020-11-20T11:29:38.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:38.986+0000 7f4d48e32700 1 -- 172.21.15.105:0/406611780 wait complete. 2020-11-20T11:29:38.999 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:39.000 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T11:29:39.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.114+0000 7f73c5c9e700 1 Processor -- start 2020-11-20T11:29:39.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.114+0000 7f73c5c9e700 1 -- start start 2020-11-20T11:29:39.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73c5c9e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73c014b390 0x7f73c014df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73c5c9e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73c00bdda0 0x7f73c0062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73c5c9e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00bfc10 con 0x7f73c014b770 2020-11-20T11:29:39.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73c5c9e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c014eec0 con 0x7f73c014b390 2020-11-20T11:29:39.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73c5c9e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c014e6e0 con 0x7f73c00bdda0 2020-11-20T11:29:39.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73c00bdda0 0x7f73c0062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73c00bdda0 0x7f73c0062780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41728/0 (socket says 172.21.15.105:41728) 2020-11-20T11:29:39.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 -- 172.21.15.105:0/2910904574 learned_addr learned my addr 172.21.15.105:0/2910904574 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bf7fe700 1 --2- 172.21.15.105:0/2910904574 >> v2:172.21.15.67:3300/0 conn(0x7f73c014b390 0x7f73c014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 -- 172.21.15.105:0/2910904574 >> v2:172.21.15.67:3300/0 conn(0x7f73c014b390 msgr2=0x7f73c014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 --2- 172.21.15.105:0/2910904574 >> v2:172.21.15.67:3300/0 conn(0x7f73c014b390 0x7f73c014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 -- 172.21.15.105:0/2910904574 >> v1:172.21.15.67:6789/0 conn(0x7f73c014b770 legacy=0x7f73c00c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 -- 172.21.15.105:0/2910904574 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c014e980 con 0x7f73c00bdda0 2020-11-20T11:29:39.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.115+0000 7f73bffff700 1 --2- 172.21.15.105:0/2910904574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c00bdda0 0x7f73c0062780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f73c0063dd0 tx=0x7f73b8009290).ready entity=mon.2 client_cookie=8679de8a3c1d475f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73be7fc700 1 -- 172.21.15.105:0/2910904574 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800bbc0 con 0x7f73c00bdda0 2020-11-20T11:29:39.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73be7fc700 1 -- 172.21.15.105:0/2910904574 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800bd20 con 0x7f73c00bdda0 2020-11-20T11:29:39.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73be7fc700 1 -- 172.21.15.105:0/2910904574 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8011610 con 0x7f73c00bdda0 2020-11-20T11:29:39.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2910904574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c00bdda0 msgr2=0x7f73c0062780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2910904574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c00bdda0 0x7f73c0062780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f73c0063dd0 tx=0x7f73b8009290).stop 2020-11-20T11:29:39.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2910904574 shutdown_connections 2020-11-20T11:29:39.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2910904574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c00bdda0 0x7f73c0062780 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2910904574 >> v2:172.21.15.67:3300/0 conn(0x7f73c014b390 0x7f73c014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2910904574 >> 172.21.15.105:0/2910904574 conn(0x7f73c00b9910 msgr2=0x7f73c00b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2910904574 shutdown_connections 2020-11-20T11:29:39.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.116+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2910904574 wait complete. 2020-11-20T11:29:39.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.117+0000 7f73c5c9e700 1 Processor -- start 2020-11-20T11:29:39.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.117+0000 7f73c5c9e700 1 -- start start 2020-11-20T11:29:39.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00bdda0 0x7f73c015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73c014b390 0x7f73c014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 0x7f73c00be400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c015d5d0 con 0x7f73c00bdda0 2020-11-20T11:29:39.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c015d870 con 0x7f73c014b390 2020-11-20T11:29:39.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73c5c9e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c015db10 con 0x7f73c014b770 2020-11-20T11:29:39.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 0x7f73c00be400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 0x7f73c00be400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41730/0 (socket says 172.21.15.105:41730) 2020-11-20T11:29:39.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 -- 172.21.15.105:0/2586874700 learned_addr learned my addr 172.21.15.105:0/2586874700 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bf7fe700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00bdda0 0x7f73c015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73beffd700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73c014b390 0x7f73c014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 -- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73c014b390 msgr2=0x7f73c014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73c014b390 0x7f73c014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 -- 172.21.15.105:0/2586874700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00bdda0 msgr2=0x7f73c015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00bdda0 0x7f73c015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73bffff700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c015ddb0 con 0x7f73c014b770 2020-11-20T11:29:39.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.118+0000 7f73beffd700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73c014b390 0x7f73c014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:39.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f73bffff700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 0x7f73c00be400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f73b8011000 tx=0x7f73b8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800bbc0 con 0x7f73c014b770 2020-11-20T11:29:39.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800be90 con 0x7f73c014b770 2020-11-20T11:29:39.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c015e4f0 con 0x7f73c014b770 2020-11-20T11:29:39.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8010da0 con 0x7f73c014b770 2020-11-20T11:29:39.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.119+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c014f9b0 con 0x7f73c014b770 2020-11-20T11:29:39.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.120+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73c015df90 con 0x7f73c014b770 2020-11-20T11:29:39.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.120+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f73b8017070 con 0x7f73c014b770 2020-11-20T11:29:39.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f739f7fe700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7398080630 0x7f7398082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f73b80a4c20 con 0x7f73c014b770 2020-11-20T11:29:39.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f739f7fe700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f7398089360 0x7f739808b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f739808bde0 con 0x7f7398089360 2020-11-20T11:29:39.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73b80a9220 con 0x7f73c014b770 2020-11-20T11:29:39.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f73bf7fe700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7398080630 0x7f7398082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f73beffd700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f7398089360 0x7f739808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f73bf7fe700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7398080630 0x7f7398082af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f73b0006fd0 tx=0x7f73b0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.121+0000 7f73beffd700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f7398089360 0x7f739808b780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.122+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== osd.6 v2:172.21.15.105:6813/24842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f739808bde0 con 0x7f7398089360 2020-11-20T11:29:39.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.138+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 --> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73c0148c80 con 0x7f7398089360 2020-11-20T11:29:39.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.138+0000 7f739f7fe700 1 -- 172.21.15.105:0/2586874700 <== osd.6 v2:172.21.15.105:6813/24842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f73c0148c80 con 0x7f7398089360 2020-11-20T11:29:39.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f7398089360 msgr2=0x7f739808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f7398089360 0x7f739808b780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7398080630 msgr2=0x7f7398082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7398080630 0x7f7398082af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f73b0006fd0 tx=0x7f73b0006df0).stop 2020-11-20T11:29:39.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 msgr2=0x7f73c00be400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 --2- 172.21.15.105:0/2586874700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73c014b770 0x7f73c00be400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f73b8011000 tx=0x7f73b8016000).stop 2020-11-20T11:29:39.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73bffff700 1 -- 172.21.15.105:0/2586874700 reap_dead start 2020-11-20T11:29:39.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 shutdown_connections 2020-11-20T11:29:39.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 >> 172.21.15.105:0/2586874700 conn(0x7f73c00b9910 msgr2=0x7f73c01454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 shutdown_connections 2020-11-20T11:29:39.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.139+0000 7f73c5c9e700 1 -- 172.21.15.105:0/2586874700 wait complete. 2020-11-20T11:29:39.153 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:39.153 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T11:29:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.268+0000 7fdd247fd700 1 Processor -- start 2020-11-20T11:29:39.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.268+0000 7fdd247fd700 1 -- start start 2020-11-20T11:29:39.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd1c0c37e0 0x7fdd1c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd1c14af60 0x7fdd1c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd1c0bfdd0 0x7fdd1c0c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c14e210 con 0x7fdd1c0bfdd0 2020-11-20T11:29:39.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c14e4b0 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd247fd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c14e750 con 0x7fdd1c14af60 2020-11-20T11:29:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd1c14af60 0x7fdd1c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd1c14af60 0x7fdd1c14b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41742/0 (socket says 172.21.15.105:41742) 2020-11-20T11:29:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 -- 172.21.15.105:0/3493100066 learned_addr learned my addr 172.21.15.105:0/3493100066 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd22599700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.100:3300/0 conn(0x7fdd1c0c37e0 0x7fdd1c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd22d9a700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.67:3300/0 conn(0x7fdd1c0bfdd0 0x7fdd1c0c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 -- 172.21.15.105:0/3493100066 >> v2:172.21.15.100:3300/0 conn(0x7fdd1c0c37e0 msgr2=0x7fdd1c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.100:3300/0 conn(0x7fdd1c0c37e0 0x7fdd1c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 -- 172.21.15.105:0/3493100066 >> v2:172.21.15.67:3300/0 conn(0x7fdd1c0bfdd0 msgr2=0x7fdd1c0c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.67:3300/0 conn(0x7fdd1c0bfdd0 0x7fdd1c0c0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 -- 172.21.15.105:0/3493100066 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c14e9f0 con 0x7fdd1c14af60 2020-11-20T11:29:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.269+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3493100066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c14af60 0x7fdd1c14b3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd1c026ab0 tx=0x7fdd0c006eb0).ready entity=mon.2 client_cookie=601550ab2e727d3b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd21597700 1 -- 172.21.15.105:0/3493100066 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0098d0 con 0x7fdd1c14af60 2020-11-20T11:29:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd21597700 1 -- 172.21.15.105:0/3493100066 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c009a30 con 0x7fdd1c14af60 2020-11-20T11:29:39.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd21597700 1 -- 172.21.15.105:0/3493100066 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c009db0 con 0x7fdd1c14af60 2020-11-20T11:29:39.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 -- 172.21.15.105:0/3493100066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c14af60 msgr2=0x7fdd1c14b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3493100066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c14af60 0x7fdd1c14b3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd1c026ab0 tx=0x7fdd0c006eb0).stop 2020-11-20T11:29:39.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 -- 172.21.15.105:0/3493100066 shutdown_connections 2020-11-20T11:29:39.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.67:3300/0 conn(0x7fdd1c0bfdd0 0x7fdd1c0c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3493100066 >> v2:172.21.15.100:3300/0 conn(0x7fdd1c0c37e0 0x7fdd1c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3493100066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c14af60 0x7fdd1c14b3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 -- 172.21.15.105:0/3493100066 >> 172.21.15.105:0/3493100066 conn(0x7fdd1c0b9910 msgr2=0x7fdd1c0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 -- 172.21.15.105:0/3493100066 shutdown_connections 2020-11-20T11:29:39.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.270+0000 7fdd247fd700 1 -- 172.21.15.105:0/3493100066 wait complete. 2020-11-20T11:29:39.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.271+0000 7fdd247fd700 1 Processor -- start 2020-11-20T11:29:39.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.271+0000 7fdd247fd700 1 -- start start 2020-11-20T11:29:39.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd1c0bfdd0 0x7fdd1c161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 0x7fdd1c161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd1c14af60 0x7fdd1c163e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c1646a0 con 0x7fdd1c0bfdd0 2020-11-20T11:29:39.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c164940 con 0x7fdd1c14af60 2020-11-20T11:29:39.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd247fd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c164be0 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 0x7fdd1c161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 0x7fdd1c161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41746/0 (socket says 172.21.15.105:41746) 2020-11-20T11:29:39.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 -- 172.21.15.105:0/3087470128 learned_addr learned my addr 172.21.15.105:0/3087470128 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd22d9a700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd1c14af60 0x7fdd1c163e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd22599700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd1c0bfdd0 0x7fdd1c161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 -- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd1c14af60 msgr2=0x7fdd1c163e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd1c14af60 0x7fdd1c163e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 -- 172.21.15.105:0/3087470128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd1c0bfdd0 msgr2=0x7fdd1c161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd1c0bfdd0 0x7fdd1c161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c160b20 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.272+0000 7fdd21d98700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 0x7fdd1c161260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdd0c00b1b0 tx=0x7fdd0c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c011e50 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c01e460 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c160dc0 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c01e800 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c161750 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.273+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd1c146e40 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.274+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fdd0c025030 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.274+0000 7fdd0a7fc700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fdcf4080630 0x7fdcf4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fdd0c0a4a30 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd0a7fc700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7fdcf4089360 0x7fdcf408b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcf408bde0 con 0x7fdcf4089360 2020-11-20T11:29:39.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd0c0a4da0 con 0x7fdd1c0c37e0 2020-11-20T11:29:39.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd22599700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fdcf4080630 0x7fdcf4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd22d9a700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7fdcf4089360 0x7fdcf408b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd22599700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fdcf4080630 0x7fdcf4082af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdd1800d8f0 tx=0x7fdd18008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.275+0000 7fdd22d9a700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7fdcf4089360 0x7fdcf408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.276+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== osd.7 v2:172.21.15.100:6811/24707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fdcf408bde0 con 0x7fdcf4089360 2020-11-20T11:29:39.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.292+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 --> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd1c14ebd0 con 0x7fdcf4089360 2020-11-20T11:29:39.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd0a7fc700 1 -- 172.21.15.105:0/3087470128 <== osd.7 v2:172.21.15.100:6811/24707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd1c14ebd0 con 0x7fdcf4089360 2020-11-20T11:29:39.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7fdcf4089360 msgr2=0x7fdcf408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7fdcf4089360 0x7fdcf408b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fdcf4080630 msgr2=0x7fdcf4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fdcf4080630 0x7fdcf4082af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdd1800d8f0 tx=0x7fdd18008040).stop 2020-11-20T11:29:39.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 msgr2=0x7fdd1c161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 --2- 172.21.15.105:0/3087470128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c0c37e0 0x7fdd1c161260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdd0c00b1b0 tx=0x7fdd0c015000).stop 2020-11-20T11:29:39.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd22d9a700 1 -- 172.21.15.105:0/3087470128 reap_dead start 2020-11-20T11:29:39.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 shutdown_connections 2020-11-20T11:29:39.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 >> 172.21.15.105:0/3087470128 conn(0x7fdd1c0b9910 msgr2=0x7fdd1c0bc010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 shutdown_connections 2020-11-20T11:29:39.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.293+0000 7fdd247fd700 1 -- 172.21.15.105:0/3087470128 wait complete. 2020-11-20T11:29:39.307 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:39.308 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T11:29:39.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.422+0000 7fef5da1c700 1 Processor -- start 2020-11-20T11:29:39.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.422+0000 7fef5da1c700 1 -- start start 2020-11-20T11:29:39.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef5da1c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fef5814e2d0 0x7fef580c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef5da1c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef58061d20 con 0x7fef580bfd60 2020-11-20T11:29:39.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef5da1c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5814d790 con 0x7fef581518e0 2020-11-20T11:29:39.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef5da1c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580be1c0 con 0x7fef5814e2d0 2020-11-20T11:29:39.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef567fc700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fef581518e0 0x7fef5814dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41358/0 (socket says 172.21.15.105:41358) 2020-11-20T11:29:39.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.423+0000 7fef567fc700 1 -- 172.21.15.105:0/3515651439 learned_addr learned my addr 172.21.15.105:0/3515651439 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:39.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef577fe700 1 --2- 172.21.15.105:0/3515651439 >> v2:172.21.15.100:3300/0 conn(0x7fef5814e2d0 0x7fef580c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346909432 0 0) 0x7fef5814d790 con 0x7fef581518e0 2020-11-20T11:29:39.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef44003240 con 0x7fef581518e0 2020-11-20T11:29:39.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1835514160 0 0) 0x7fef44003240 con 0x7fef581518e0 2020-11-20T11:29:39.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 >> v2:172.21.15.100:3300/0 conn(0x7fef5814e2d0 msgr2=0x7fef580c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 --2- 172.21.15.105:0/3515651439 >> v2:172.21.15.100:3300/0 conn(0x7fef5814e2d0 0x7fef580c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 >> v1:172.21.15.100:6789/0 conn(0x7fef580bfd60 legacy=0x7fef58067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580be460 con 0x7fef581518e0 2020-11-20T11:29:39.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fef480014e0 con 0x7fef581518e0 2020-11-20T11:29:39.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 >> v1:172.21.15.105:6789/0 conn(0x7fef581518e0 legacy=0x7fef5814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44003780 0x7fef44003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 0x7fef44004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44004e50 0x7fef4400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580be1c0 con 0x7fef44004e50 2020-11-20T11:29:39.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44005300 con 0x7fef44003780 2020-11-20T11:29:39.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4400cd30 con 0x7fef440044e0 2020-11-20T11:29:39.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 0x7fef44004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef56ffd700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44003780 0x7fef44003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 -- 172.21.15.105:0/3515651439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44003780 msgr2=0x7fef44003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44003780 0x7fef44003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 -- 172.21.15.105:0/3515651439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44004e50 msgr2=0x7fef4400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44004e50 0x7fef4400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:29:39.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef577fe700 1 -- 172.21.15.105:0/3515651439 reap_dead start 2020-11-20T11:29:39.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 -- 172.21.15.105:0/3515651439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44003240 con 0x7fef440044e0 2020-11-20T11:29:39.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef567fc700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 0x7fef44004960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fef48007e50 tx=0x7fef580be5f0).ready entity=mon.2 client_cookie=4b6be8f9056a16f0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.424+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480070d0 con 0x7fef440044e0 2020-11-20T11:29:39.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48007230 con 0x7fef440044e0 2020-11-20T11:29:39.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef55ffb700 1 -- 172.21.15.105:0/3515651439 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480055f0 con 0x7fef440044e0 2020-11-20T11:29:39.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 -- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 msgr2=0x7fef44004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 0x7fef44004960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fef48007e50 tx=0x7fef580be5f0).stop 2020-11-20T11:29:39.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 -- 172.21.15.105:0/3515651439 shutdown_connections 2020-11-20T11:29:39.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 --2- 172.21.15.105:0/3515651439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef440044e0 0x7fef44004960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 -- 172.21.15.105:0/3515651439 >> 172.21.15.105:0/3515651439 conn(0x7fef580b9910 msgr2=0x7fef580b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 -- 172.21.15.105:0/3515651439 shutdown_connections 2020-11-20T11:29:39.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.425+0000 7fef5da1c700 1 -- 172.21.15.105:0/3515651439 wait complete. 2020-11-20T11:29:39.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.426+0000 7fef5da1c700 1 Processor -- start 2020-11-20T11:29:39.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.426+0000 7fef5da1c700 1 -- start start 2020-11-20T11:29:39.441 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef440044e0 0x7fef580c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef580c2cf0 0x7fef580925d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 0x7fef58092ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5815f900 con 0x7fef440044e0 2020-11-20T11:29:39.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5815fba0 con 0x7fef580c2cf0 2020-11-20T11:29:39.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef5da1c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5815fe40 con 0x7fef580bd2d0 2020-11-20T11:29:39.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 0x7fef58092ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 0x7fef58092ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41768/0 (socket says 172.21.15.105:41768) 2020-11-20T11:29:39.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 -- 172.21.15.105:0/480528121 learned_addr learned my addr 172.21.15.105:0/480528121 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef567fc700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef580c2cf0 0x7fef580925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef56ffd700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef440044e0 0x7fef580c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 -- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef580c2cf0 msgr2=0x7fef580925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef580c2cf0 0x7fef580925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 -- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef440044e0 msgr2=0x7fef580c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef440044e0 0x7fef580c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef581600e0 con 0x7fef580bd2d0 2020-11-20T11:29:39.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.427+0000 7fef577fe700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 0x7fef58092ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fef500090e0 tx=0x7fef500091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50017070 con 0x7fef580bd2d0 2020-11-20T11:29:39.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000c610 con 0x7fef580bd2d0 2020-11-20T11:29:39.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000c9b0 con 0x7fef580bd2d0 2020-11-20T11:29:39.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef58160380 con 0x7fef580bd2d0 2020-11-20T11:29:39.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58149030 con 0x7fef580bd2d0 2020-11-20T11:29:39.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.428+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef581607e0 con 0x7fef580bd2d0 2020-11-20T11:29:39.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.429+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fef5000cda0 con 0x7fef580bd2d0 2020-11-20T11:29:39.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef3effd700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fef34080660 0x7fef34082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fef500a3320 con 0x7fef580bd2d0 2020-11-20T11:29:39.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef3effd700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fef34089390 0x7fef3408b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef3408be10 con 0x7fef34089390 2020-11-20T11:29:39.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef500a3690 con 0x7fef580bd2d0 2020-11-20T11:29:39.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef56ffd700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fef34080660 0x7fef34082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef567fc700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fef34089390 0x7fef3408b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.430+0000 7fef56ffd700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fef34080660 0x7fef34082b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fef4c007fd0 tx=0x7fef4c007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.431+0000 7fef567fc700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fef34089390 0x7fef3408b7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.432+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== osd.8 v2:172.21.15.67:6816/25152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fef3408be10 con 0x7fef34089390 2020-11-20T11:29:39.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.447+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 --> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef5814bd30 con 0x7fef34089390 2020-11-20T11:29:39.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef3effd700 1 -- 172.21.15.105:0/480528121 <== osd.8 v2:172.21.15.67:6816/25152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef5814bd30 con 0x7fef34089390 2020-11-20T11:29:39.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fef34089390 msgr2=0x7fef3408b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fef34089390 0x7fef3408b7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.453 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fef34080660 msgr2=0x7fef34082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.453 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fef34080660 0x7fef34082b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fef4c007fd0 tx=0x7fef4c007b90).stop 2020-11-20T11:29:39.453 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 msgr2=0x7fef58092ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.453 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef5da1c700 1 --2- 172.21.15.105:0/480528121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef580bd2d0 0x7fef58092ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fef500090e0 tx=0x7fef500091d0).stop 2020-11-20T11:29:39.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.448+0000 7fef577fe700 1 -- 172.21.15.105:0/480528121 reap_dead start 2020-11-20T11:29:39.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.449+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 shutdown_connections 2020-11-20T11:29:39.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.449+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 >> 172.21.15.105:0/480528121 conn(0x7fef580b9910 msgr2=0x7fef58066fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.449+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 shutdown_connections 2020-11-20T11:29:39.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.449+0000 7fef5da1c700 1 -- 172.21.15.105:0/480528121 wait complete. 2020-11-20T11:29:39.463 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:39.463 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T11:29:39.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.577+0000 7f9d48521700 1 Processor -- start 2020-11-20T11:29:39.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.577+0000 7f9d48521700 1 -- start start 2020-11-20T11:29:39.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d48521700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d4014b390 0x7f9d4014df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d48521700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9d4014b770 0x7f9d400c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d48521700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d400bfc10 con 0x7f9d400c0aa0 2020-11-20T11:29:39.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d48521700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4014eec0 con 0x7f9d4014b770 2020-11-20T11:29:39.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d48521700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4014e6e0 con 0x7f9d4014b390 2020-11-20T11:29:39.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d4014b390 0x7f9d4014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d4014b390 0x7f9d4014df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41774/0 (socket says 172.21.15.105:41774) 2020-11-20T11:29:39.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 -- 172.21.15.105:0/743358113 learned_addr learned my addr 172.21.15.105:0/743358113 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d45abc700 1 --2- 172.21.15.105:0/743358113 >> v2:172.21.15.100:3300/0 conn(0x7f9d4014b770 0x7f9d400c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 -- 172.21.15.105:0/743358113 >> v2:172.21.15.100:3300/0 conn(0x7f9d4014b770 msgr2=0x7f9d400c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 --2- 172.21.15.105:0/743358113 >> v2:172.21.15.100:3300/0 conn(0x7f9d4014b770 0x7f9d400c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.578+0000 7f9d462bd700 1 -- 172.21.15.105:0/743358113 >> v1:172.21.15.67:6789/0 conn(0x7f9d400c0aa0 legacy=0x7f9d40062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d462bd700 1 -- 172.21.15.105:0/743358113 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4014e980 con 0x7f9d4014b390 2020-11-20T11:29:39.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d452bb700 1 -- 172.21.15.105:0/743358113 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616443667 0 0) 0x7f9d400bfc10 con 0x7f9d400c0aa0 2020-11-20T11:29:39.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d462bd700 1 --2- 172.21.15.105:0/743358113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b390 0x7f9d4014df20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9d400c36a0 tx=0x7f9d30006eb0).ready entity=mon.2 client_cookie=9b0211615d80553a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d452bb700 1 -- 172.21.15.105:0/743358113 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300098d0 con 0x7f9d4014b390 2020-11-20T11:29:39.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d452bb700 1 -- 172.21.15.105:0/743358113 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30009a30 con 0x7f9d4014b390 2020-11-20T11:29:39.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d452bb700 1 -- 172.21.15.105:0/743358113 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30009db0 con 0x7f9d4014b390 2020-11-20T11:29:39.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 -- 172.21.15.105:0/743358113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b390 msgr2=0x7f9d4014df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 --2- 172.21.15.105:0/743358113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b390 0x7f9d4014df20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9d400c36a0 tx=0x7f9d30006eb0).stop 2020-11-20T11:29:39.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 -- 172.21.15.105:0/743358113 shutdown_connections 2020-11-20T11:29:39.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 --2- 172.21.15.105:0/743358113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b390 0x7f9d4014df20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 --2- 172.21.15.105:0/743358113 >> v2:172.21.15.100:3300/0 conn(0x7f9d4014b770 0x7f9d400c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 -- 172.21.15.105:0/743358113 >> 172.21.15.105:0/743358113 conn(0x7f9d400b9910 msgr2=0x7f9d400b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 -- 172.21.15.105:0/743358113 shutdown_connections 2020-11-20T11:29:39.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.579+0000 7f9d48521700 1 -- 172.21.15.105:0/743358113 wait complete. 2020-11-20T11:29:39.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.580+0000 7f9d48521700 1 Processor -- start 2020-11-20T11:29:39.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.580+0000 7f9d48521700 1 -- start start 2020-11-20T11:29:39.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d400c0aa0 0x7f9d40133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d4014b390 0x7f9d4014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 0x7f9d401647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40164cb0 con 0x7f9d4014b390 2020-11-20T11:29:39.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4013d1a0 con 0x7f9d400c0aa0 2020-11-20T11:29:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d48521700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4013e560 con 0x7f9d4014b770 2020-11-20T11:29:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 0x7f9d401647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 0x7f9d401647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41780/0 (socket says 172.21.15.105:41780) 2020-11-20T11:29:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 -- 172.21.15.105:0/3702372623 learned_addr learned my addr 172.21.15.105:0/3702372623 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d462bd700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d400c0aa0 0x7f9d40133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d45abc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d4014b390 0x7f9d4014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 -- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d400c0aa0 msgr2=0x7f9d40133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d400c0aa0 0x7f9d40133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 -- 172.21.15.105:0/3702372623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d4014b390 msgr2=0x7f9d4014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d4014b390 0x7f9d4014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d46abe700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4013e800 con 0x7f9d4014b770 2020-11-20T11:29:39.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.581+0000 7f9d45abc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d4014b390 0x7f9d4014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:39.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d46abe700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 0x7f9d401647c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9d3800cab0 tx=0x7f9d38007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800a8c0 con 0x7f9d4014b770 2020-11-20T11:29:39.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800aa20 con 0x7f9d4014b770 2020-11-20T11:29:39.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4014bcf0 con 0x7f9d4014b770 2020-11-20T11:29:39.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800ade0 con 0x7f9d4014b770 2020-11-20T11:29:39.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d40138690 con 0x7f9d4014b770 2020-11-20T11:29:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.582+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d4014bb70 con 0x7f9d4014b770 2020-11-20T11:29:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9d38022070 con 0x7f9d4014b770 2020-11-20T11:29:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9d18080630 0x7f9d18082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9d380a2ce0 con 0x7f9d4014b770 2020-11-20T11:29:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d462bd700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9d18080630 0x7f9d18082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f9d18089360 0x7f9d1808b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d1808bde0 con 0x7f9d18089360 2020-11-20T11:29:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d380a2fd0 con 0x7f9d4014b770 2020-11-20T11:29:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d45abc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f9d18089360 0x7f9d1808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.584+0000 7f9d462bd700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9d18080630 0x7f9d18082af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9d30006ef0 tx=0x7f9d30015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.585+0000 7f9d45abc700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f9d18089360 0x7f9d1808b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.585+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== osd.9 v2:172.21.15.105:6824/24843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9d1808bde0 con 0x7f9d18089360 2020-11-20T11:29:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.601+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 --> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d400669d0 con 0x7f9d18089360 2020-11-20T11:29:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d2e7fc700 1 -- 172.21.15.105:0/3702372623 <== osd.9 v2:172.21.15.105:6824/24843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d400669d0 con 0x7f9d18089360 2020-11-20T11:29:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f9d18089360 msgr2=0x7f9d1808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f9d18089360 0x7f9d1808b780 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9d18080630 msgr2=0x7f9d18082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9d18080630 0x7f9d18082af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9d30006ef0 tx=0x7f9d30015000).stop 2020-11-20T11:29:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 msgr2=0x7f9d401647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 --2- 172.21.15.105:0/3702372623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4014b770 0x7f9d401647c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9d3800cab0 tx=0x7f9d38007d30).stop 2020-11-20T11:29:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d46abe700 1 -- 172.21.15.105:0/3702372623 reap_dead start 2020-11-20T11:29:39.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 shutdown_connections 2020-11-20T11:29:39.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 >> 172.21.15.105:0/3702372623 conn(0x7f9d400b9910 msgr2=0x7f9d40065800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 shutdown_connections 2020-11-20T11:29:39.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.602+0000 7f9d48521700 1 -- 172.21.15.105:0/3702372623 wait complete. 2020-11-20T11:29:39.616 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:39.616 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T11:29:39.735 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.732+0000 7f6b45aa6700 1 Processor -- start 2020-11-20T11:29:39.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.732+0000 7f6b45aa6700 1 -- start start 2020-11-20T11:29:39.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b45aa6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b400bb9b0 0x7f6b40062390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b45aa6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4014d4e0 0x7f6b400bc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b45aa6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4014da60 con 0x7f6b40061fb0 2020-11-20T11:29:39.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b45aa6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4014dd00 con 0x7f6b4014d4e0 2020-11-20T11:29:39.739 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b45aa6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4014dfa0 con 0x7f6b400bb9b0 2020-11-20T11:29:39.739 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b400bb9b0 0x7f6b40062390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.739 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b400bb9b0 0x7f6b40062390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59918/0 (socket says 172.21.15.105:59918) 2020-11-20T11:29:39.739 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 -- 172.21.15.105:0/1106900877 learned_addr learned my addr 172.21.15.105:0/1106900877 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.739 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b452a5700 1 --2- 172.21.15.105:0/1106900877 >> v2:172.21.15.67:3300/0 conn(0x7f6b4014d4e0 0x7f6b400bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.740 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 -- 172.21.15.105:0/1106900877 >> v2:172.21.15.67:3300/0 conn(0x7f6b4014d4e0 msgr2=0x7f6b400bc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.740 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 --2- 172.21.15.105:0/1106900877 >> v2:172.21.15.67:3300/0 conn(0x7f6b4014d4e0 0x7f6b400bc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.740 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 -- 172.21.15.105:0/1106900877 >> v1:172.21.15.67:6789/0 conn(0x7f6b40061fb0 legacy=0x7f6b400bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.740 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 -- 172.21.15.105:0/1106900877 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4014e240 con 0x7f6b400bb9b0 2020-11-20T11:29:39.741 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.733+0000 7f6b37fff700 1 --2- 172.21.15.105:0/1106900877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b400bb9b0 0x7f6b40062390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6b400bb0e0 tx=0x7f6b30006f40).ready entity=mon.1 client_cookie=2b4fc8de58dadd4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.741 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b377fe700 1 -- 172.21.15.105:0/1106900877 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000cad0 con 0x7f6b400bb9b0 2020-11-20T11:29:39.741 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b377fe700 1 -- 172.21.15.105:0/1106900877 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3000cc30 con 0x7f6b400bb9b0 2020-11-20T11:29:39.741 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b377fe700 1 -- 172.21.15.105:0/1106900877 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30010410 con 0x7f6b400bb9b0 2020-11-20T11:29:39.741 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 -- 172.21.15.105:0/1106900877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b400bb9b0 msgr2=0x7f6b40062390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.742 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/1106900877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b400bb9b0 0x7f6b40062390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6b400bb0e0 tx=0x7f6b30006f40).stop 2020-11-20T11:29:39.742 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 -- 172.21.15.105:0/1106900877 shutdown_connections 2020-11-20T11:29:39.742 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/1106900877 >> v2:172.21.15.67:3300/0 conn(0x7f6b4014d4e0 0x7f6b400bc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.742 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/1106900877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b400bb9b0 0x7f6b40062390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.742 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 -- 172.21.15.105:0/1106900877 >> 172.21.15.105:0/1106900877 conn(0x7f6b40025a60 msgr2=0x7f6b40025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.743 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 -- 172.21.15.105:0/1106900877 shutdown_connections 2020-11-20T11:29:39.743 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.734+0000 7f6b45aa6700 1 -- 172.21.15.105:0/1106900877 wait complete. 2020-11-20T11:29:39.746 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.735+0000 7f6b45aa6700 1 Processor -- start 2020-11-20T11:29:39.746 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.735+0000 7f6b45aa6700 1 -- start start 2020-11-20T11:29:39.746 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b40061fb0 0x7f6b40026000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.747 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 0x7f6b4015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.747 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4014d4e0 0x7f6b4014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.747 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015d9b0 con 0x7f6b40061fb0 2020-11-20T11:29:39.747 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015dc50 con 0x7f6b4014d4e0 2020-11-20T11:29:39.747 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b45aa6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015def0 con 0x7f6b400bb9b0 2020-11-20T11:29:39.748 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 0x7f6b4015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.748 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 0x7f6b4015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41798/0 (socket says 172.21.15.105:41798) 2020-11-20T11:29:39.748 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 -- 172.21.15.105:0/2630829260 learned_addr learned my addr 172.21.15.105:0/2630829260 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.748 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b44aa4700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b40061fb0 0x7f6b40026000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.748 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b452a5700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4014d4e0 0x7f6b4014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.749 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 -- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4014d4e0 msgr2=0x7f6b4014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.749 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4014d4e0 0x7f6b4014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.749 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 -- 172.21.15.105:0/2630829260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b40061fb0 msgr2=0x7f6b40026000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.749 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b40061fb0 0x7f6b40026000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.749 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.736+0000 7f6b37fff700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4015e190 con 0x7f6b400bb9b0 2020-11-20T11:29:39.750 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b37fff700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 0x7f6b4015eb70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6b30006c90 tx=0x7f6b4014dbf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.750 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30010e70 con 0x7f6b400bb9b0 2020-11-20T11:29:39.750 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3001a650 con 0x7f6b400bb9b0 2020-11-20T11:29:39.750 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4015e430 con 0x7f6b400bb9b0 2020-11-20T11:29:39.750 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3001a9f0 con 0x7f6b400bb9b0 2020-11-20T11:29:39.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4015cd90 con 0x7f6b400bb9b0 2020-11-20T11:29:39.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.737+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b4005ca10 con 0x7f6b400bb9b0 2020-11-20T11:29:39.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.738+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6b3000e040 con 0x7f6b400bb9b0 2020-11-20T11:29:39.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b34ff9700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6b18080630 0x7f6b18082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6b300a4810 con 0x7f6b400bb9b0 2020-11-20T11:29:39.752 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b34ff9700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f6b180892e0 0x7f6b1808b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.752 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b1808bd60 con 0x7f6b180892e0 2020-11-20T11:29:39.752 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b300a4b80 con 0x7f6b400bb9b0 2020-11-20T11:29:39.752 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b44aa4700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6b18080630 0x7f6b18082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.752 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b452a5700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f6b180892e0 0x7f6b1808b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.753 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.739+0000 7f6b44aa4700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6b18080630 0x7f6b18082af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6b3c000bc0 tx=0x7f6b3c007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.753 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.740+0000 7f6b452a5700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f6b180892e0 0x7f6b1808b700 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.753 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.740+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== osd.10 v2:172.21.15.100:6826/24710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f6b1808bd60 con 0x7f6b180892e0 2020-11-20T11:29:39.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.756+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 --> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b4015e890 con 0x7f6b180892e0 2020-11-20T11:29:39.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b34ff9700 1 -- 172.21.15.105:0/2630829260 <== osd.10 v2:172.21.15.100:6826/24710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b4015e890 con 0x7f6b180892e0 2020-11-20T11:29:39.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f6b180892e0 msgr2=0x7f6b1808b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f6b180892e0 0x7f6b1808b700 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6b18080630 msgr2=0x7f6b18082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6b18080630 0x7f6b18082af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6b3c000bc0 tx=0x7f6b3c007b70).stop 2020-11-20T11:29:39.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 msgr2=0x7f6b4015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 --2- 172.21.15.105:0/2630829260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b400bb9b0 0x7f6b4015eb70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6b30006c90 tx=0x7f6b4014dbf0).stop 2020-11-20T11:29:39.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b452a5700 1 -- 172.21.15.105:0/2630829260 reap_dead start 2020-11-20T11:29:39.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 shutdown_connections 2020-11-20T11:29:39.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 >> 172.21.15.105:0/2630829260 conn(0x7f6b40025a60 msgr2=0x7f6b400be4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 shutdown_connections 2020-11-20T11:29:39.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.758+0000 7f6b45aa6700 1 -- 172.21.15.105:0/2630829260 wait complete. 2020-11-20T11:29:39.771 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:39.772 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T11:29:39.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.891+0000 7f90adc35700 1 Processor -- start 2020-11-20T11:29:39.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.891+0000 7f90adc35700 1 -- start start 2020-11-20T11:29:39.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90adc35700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90a80c37e0 0x7f90a80c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90adc35700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90a814af60 0x7f90a814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90adc35700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a814e210 con 0x7f90a80bfdd0 2020-11-20T11:29:39.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90adc35700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a814e4b0 con 0x7f90a80c37e0 2020-11-20T11:29:39.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90adc35700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a814e750 con 0x7f90a814af60 2020-11-20T11:29:39.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90a814af60 0x7f90a814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a77fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90a80c37e0 0x7f90a80c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90a814af60 0x7f90a814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:59932/0 (socket says 172.21.15.105:59932) 2020-11-20T11:29:39.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a7fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f90a80bfdd0 0x7f90a80c0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60424/0 (socket says 172.21.15.105:60424) 2020-11-20T11:29:39.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 -- 172.21.15.105:0/1933492074 learned_addr learned my addr 172.21.15.105:0/1933492074 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 -- 172.21.15.105:0/1933492074 >> v2:172.21.15.67:3300/0 conn(0x7f90a80c37e0 msgr2=0x7f90a80c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:39.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 --2- 172.21.15.105:0/1933492074 >> v2:172.21.15.67:3300/0 conn(0x7f90a80c37e0 0x7f90a80c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 -- 172.21.15.105:0/1933492074 >> v1:172.21.15.100:6789/0 conn(0x7f90a80bfdd0 legacy=0x7f90a80c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.892+0000 7f90a6ffd700 1 -- 172.21.15.105:0/1933492074 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a814e9f0 con 0x7f90a814af60 2020-11-20T11:29:39.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90a6ffd700 1 --2- 172.21.15.105:0/1933492074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a814af60 0x7f90a814b3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f90a80ba450 tx=0x7f909c006eb0).ready entity=mon.1 client_cookie=15283e96b5a9b401 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90a67fc700 1 -- 172.21.15.105:0/1933492074 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c009810 con 0x7f90a814af60 2020-11-20T11:29:39.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90a67fc700 1 -- 172.21.15.105:0/1933492074 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c009970 con 0x7f90a814af60 2020-11-20T11:29:39.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90a67fc700 1 -- 172.21.15.105:0/1933492074 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c009cf0 con 0x7f90a814af60 2020-11-20T11:29:39.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 -- 172.21.15.105:0/1933492074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a814af60 msgr2=0x7f90a814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 --2- 172.21.15.105:0/1933492074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a814af60 0x7f90a814b3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f90a80ba450 tx=0x7f909c006eb0).stop 2020-11-20T11:29:39.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 -- 172.21.15.105:0/1933492074 shutdown_connections 2020-11-20T11:29:39.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 --2- 172.21.15.105:0/1933492074 >> v2:172.21.15.67:3300/0 conn(0x7f90a80c37e0 0x7f90a80c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 --2- 172.21.15.105:0/1933492074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a814af60 0x7f90a814b3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 -- 172.21.15.105:0/1933492074 >> 172.21.15.105:0/1933492074 conn(0x7f90a80b9910 msgr2=0x7f90a80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 -- 172.21.15.105:0/1933492074 shutdown_connections 2020-11-20T11:29:39.907 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.893+0000 7f90adc35700 1 -- 172.21.15.105:0/1933492074 wait complete. 2020-11-20T11:29:39.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.894+0000 7f90adc35700 1 Processor -- start 2020-11-20T11:29:39.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 -- start start 2020-11-20T11:29:39.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 0x7f90a8161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a80c37e0 0x7f90a8094f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a814af60 0x7f90a8152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8164d70 con 0x7f90a814af60 2020-11-20T11:29:39.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8164830 con 0x7f90a80c37e0 2020-11-20T11:29:39.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90adc35700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8164ad0 con 0x7f90a80bfdd0 2020-11-20T11:29:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 0x7f90a8161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 0x7f90a8161450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41808/0 (socket says 172.21.15.105:41808) 2020-11-20T11:29:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.895+0000 7f90a77fe700 1 -- 172.21.15.105:0/5757614 learned_addr learned my addr 172.21.15.105:0/5757614 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a6ffd700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a80c37e0 0x7f90a8094f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a7fff700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a814af60 0x7f90a8152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 -- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a80c37e0 msgr2=0x7f90a8094f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a80c37e0 0x7f90a8094f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 -- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a814af60 msgr2=0x7f90a8152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a814af60 0x7f90a8152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8160a70 con 0x7f90a80bfdd0 2020-11-20T11:29:39.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90a77fe700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 0x7f90a8161450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f909800ebd0 tx=0x7f9098006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800ba30 con 0x7f90a80bfdd0 2020-11-20T11:29:39.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800bb90 con 0x7f90a80bfdd0 2020-11-20T11:29:39.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980123f0 con 0x7f90a80bfdd0 2020-11-20T11:29:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8160d10 con 0x7f90a80bfdd0 2020-11-20T11:29:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.896+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a80953f0 con 0x7f90a80bfdd0 2020-11-20T11:29:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.897+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90a80bb3e0 con 0x7f90a80bfdd0 2020-11-20T11:29:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9098012760 con 0x7f90a80bfdd0 2020-11-20T11:29:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9080080630 0x7f9080082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f90980a3990 con 0x7f90a80bfdd0 2020-11-20T11:29:39.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90a6ffd700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9080080630 0x7f9080082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f90800892e0 0x7f908008b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:39.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f908008bd60 con 0x7f90800892e0 2020-11-20T11:29:39.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90980a3d00 con 0x7f90a80bfdd0 2020-11-20T11:29:39.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90a6ffd700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9080080630 0x7f9080082af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90a80ba450 tx=0x7f909c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.898+0000 7f90a7fff700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f90800892e0 0x7f908008b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:39.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.899+0000 7f90a7fff700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f90800892e0 0x7f908008b700 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:39.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.900+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== osd.11 v2:172.21.15.67:6800/25149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f908008bd60 con 0x7f90800892e0 2020-11-20T11:29:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.916+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 --> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90a8044f60 con 0x7f90800892e0 2020-11-20T11:29:39.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.916+0000 7f90877fe700 1 -- 172.21.15.105:0/5757614 <== osd.11 v2:172.21.15.67:6800/25149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90a8044f60 con 0x7f90800892e0 2020-11-20T11:29:39.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f90800892e0 msgr2=0x7f908008b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f90800892e0 0x7f908008b700 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:39.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9080080630 msgr2=0x7f9080082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f9080080630 0x7f9080082af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90a80ba450 tx=0x7f909c015000).stop 2020-11-20T11:29:39.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 msgr2=0x7f90a8161450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:39.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 --2- 172.21.15.105:0/5757614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a80bfdd0 0x7f90a8161450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f909800ebd0 tx=0x7f9098006df0).stop 2020-11-20T11:29:39.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90a7fff700 1 -- 172.21.15.105:0/5757614 reap_dead start 2020-11-20T11:29:39.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 shutdown_connections 2020-11-20T11:29:39.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 >> 172.21.15.105:0/5757614 conn(0x7f90a80b9910 msgr2=0x7f90a80bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:39.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 shutdown_connections 2020-11-20T11:29:39.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:39.917+0000 7f90adc35700 1 -- 172.21.15.105:0/5757614 wait complete. 2020-11-20T11:29:39.931 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:39.931 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:29:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.046+0000 7f10984dc700 1 Processor -- start 2020-11-20T11:29:40.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.046+0000 7f10984dc700 1 -- start start 2020-11-20T11:29:40.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f10984dc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10900c01c0 0x7f10900c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f10984dc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090151870 con 0x7f1090151330 2020-11-20T11:29:40.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f10984dc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090151b10 con 0x7f10901552a0 2020-11-20T11:29:40.131 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f10984dc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090155730 con 0x7f10900c01c0 2020-11-20T11:29:40.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f1096a79700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f10901552a0 0x7f1090150280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41422/0 (socket says 172.21.15.105:41422) 2020-11-20T11:29:40.132 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f1096a79700 1 -- 172.21.15.105:0/1888288458 learned_addr learned my addr 172.21.15.105:0/1888288458 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:40.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.047+0000 7f1096278700 1 --2- 172.21.15.105:0/1888288458 >> v2:172.21.15.100:3300/0 conn(0x7f10900c01c0 0x7f10900c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042990949 0 0) 0x7f1090151b10 con 0x7f10901552a0 2020-11-20T11:29:40.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1078003240 con 0x7f10901552a0 2020-11-20T11:29:40.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238886820 0 0) 0x7f1090151870 con 0x7f1090151330 2020-11-20T11:29:40.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1096278700 1 -- 172.21.15.105:0/1888288458 >> v1:172.21.15.105:6789/0 conn(0x7f10901552a0 legacy=0x7f1090150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1096278700 1 -- 172.21.15.105:0/1888288458 >> v1:172.21.15.67:6789/0 conn(0x7f1090151330 legacy=0x7f109009bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1096278700 1 -- 172.21.15.105:0/1888288458 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090151db0 con 0x7f10900c01c0 2020-11-20T11:29:40.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1096278700 1 --2- 172.21.15.105:0/1888288458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10900c01c0 0x7f10900c05a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f108000b920 tx=0x7f1080006df0).ready entity=mon.1 client_cookie=930fe96aa70d5aad server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088001860 con 0x7f10900c01c0 2020-11-20T11:29:40.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080012460 con 0x7f10900c01c0 2020-11-20T11:29:40.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f1095276700 1 -- 172.21.15.105:0/1888288458 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800127e0 con 0x7f10900c01c0 2020-11-20T11:29:40.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f10984dc700 1 -- 172.21.15.105:0/1888288458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10900c01c0 msgr2=0x7f10900c05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.048+0000 7f10984dc700 1 --2- 172.21.15.105:0/1888288458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10900c01c0 0x7f10900c05a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f108000b920 tx=0x7f1080006df0).stop 2020-11-20T11:29:40.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.049+0000 7f10984dc700 1 -- 172.21.15.105:0/1888288458 shutdown_connections 2020-11-20T11:29:40.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.049+0000 7f10984dc700 1 --2- 172.21.15.105:0/1888288458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10900c01c0 0x7f10900c05a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.049+0000 7f10984dc700 1 -- 172.21.15.105:0/1888288458 >> 172.21.15.105:0/1888288458 conn(0x7f1090025a60 msgr2=0x7f1090025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.049+0000 7f10984dc700 1 -- 172.21.15.105:0/1888288458 shutdown_connections 2020-11-20T11:29:40.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.049+0000 7f10984dc700 1 -- 172.21.15.105:0/1888288458 wait complete. 2020-11-20T11:29:40.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 Processor -- start 2020-11-20T11:29:40.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 -- start start 2020-11-20T11:29:40.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10900c01c0 0x7f1090061c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 0x7f10900641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900646a0 con 0x7f10900c01c0 2020-11-20T11:29:40.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090063d40 con 0x7f10901552a0 2020-11-20T11:29:40.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f10984dc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900635a0 con 0x7f1090151330 2020-11-20T11:29:40.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.050+0000 7f1095a77700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.150 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41828/0 (socket says 172.21.15.105:41828) 2020-11-20T11:29:40.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 -- 172.21.15.105:0/4040239834 learned_addr learned my addr 172.21.15.105:0/4040239834 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:40.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1096a79700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 0x7f10900641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1096278700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10900c01c0 0x7f1090061c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 -- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 msgr2=0x7f10900641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 0x7f10900641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 -- 172.21.15.105:0/4040239834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10900c01c0 msgr2=0x7f1090061c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10900c01c0 0x7f1090061c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 -- 172.21.15.105:0/4040239834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10901550d0 con 0x7f1090151330 2020-11-20T11:29:40.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1096a79700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 0x7f10900641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:40.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f1095a77700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f108c00c6e0 tx=0x7f108c007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00e560 con 0x7f1090151330 2020-11-20T11:29:40.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00e6c0 con 0x7f1090151330 2020-11-20T11:29:40.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1090063800 con 0x7f1090151330 2020-11-20T11:29:40.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00ea80 con 0x7f1090151330 2020-11-20T11:29:40.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.051+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1090160800 con 0x7f1090151330 2020-11-20T11:29:40.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.052+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090044f60 con 0x7f1090151330 2020-11-20T11:29:40.157 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.053+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f108c019030 con 0x7f1090151330 2020-11-20T11:29:40.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.053+0000 7f107e7fc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 0x7f1068082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.053+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f108c0a1ff0 con 0x7f1090151330 2020-11-20T11:29:40.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.053+0000 7f1096278700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 0x7f1068082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.054+0000 7f1096278700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 0x7f1068082af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f108000b150 tx=0x7f1090151a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.056+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f108c076a90 con 0x7f1090151330 2020-11-20T11:29:40.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.219+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f109005cc80 con 0x7f1090151330 2020-11-20T11:29:40.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.220+0000 7f107e7fc700 1 -- 172.21.15.105:0/4040239834 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f108c007b80 con 0x7f1090151330 2020-11-20T11:29:40.224 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:40.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 msgr2=0x7f1068082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 0x7f1068082af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f108000b150 tx=0x7f1090151a00).stop 2020-11-20T11:29:40.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 msgr2=0x7f1090163bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f108c00c6e0 tx=0x7f108c007a40).stop 2020-11-20T11:29:40.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 shutdown_connections 2020-11-20T11:29:40.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10901552a0 0x7f10900641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10900c01c0 0x7f1090061c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1068080630 0x7f1068082af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 --2- 172.21.15.105:0/4040239834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1090151330 0x7f1090163bd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 >> 172.21.15.105:0/4040239834 conn(0x7f1090025a60 msgr2=0x7f10900c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 shutdown_connections 2020-11-20T11:29:40.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.221+0000 7f10984dc700 1 -- 172.21.15.105:0/4040239834 wait complete. 2020-11-20T11:29:40.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.0 2020-11-20T11:29:40.236 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T11:29:40.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.367+0000 7efe0256b700 1 Processor -- start 2020-11-20T11:29:40.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.367+0000 7efe0256b700 1 -- start start 2020-11-20T11:29:40.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe0256b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdfc0c0060 0x7efdfc0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe0256b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efdfc14e390 0x7efdfc14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe0256b700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0becf0 con 0x7efdfc0bdda0 2020-11-20T11:29:40.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe0256b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0be270 con 0x7efdfc14e390 2020-11-20T11:29:40.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe0256b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0be510 con 0x7efdfc0c0060 2020-11-20T11:29:40.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdfc0c0060 0x7efdfc0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdfc0c0060 0x7efdfc0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41832/0 (socket says 172.21.15.105:41832) 2020-11-20T11:29:40.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 -- 172.21.15.105:0/1526774177 learned_addr learned my addr 172.21.15.105:0/1526774177 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:40.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efe00b08700 1 --2- 172.21.15.105:0/1526774177 >> v2:172.21.15.67:3300/0 conn(0x7efdfc14e390 0x7efdfc14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 -- 172.21.15.105:0/1526774177 >> v2:172.21.15.67:3300/0 conn(0x7efdfc14e390 msgr2=0x7efdfc14cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 --2- 172.21.15.105:0/1526774177 >> v2:172.21.15.67:3300/0 conn(0x7efdfc14e390 0x7efdfc14cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 -- 172.21.15.105:0/1526774177 >> v1:172.21.15.100:6789/0 conn(0x7efdfc0bdda0 legacy=0x7efdfc14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.368+0000 7efdfbfff700 1 -- 172.21.15.105:0/1526774177 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0be7b0 con 0x7efdfc0c0060 2020-11-20T11:29:40.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efdfbfff700 1 --2- 172.21.15.105:0/1526774177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc0c0440 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efdfc0ba430 tx=0x7efdec006eb0).ready entity=mon.2 client_cookie=a7dcd14b84f0dbb3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efdfaffd700 1 -- 172.21.15.105:0/1526774177 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0098a0 con 0x7efdfc0c0060 2020-11-20T11:29:40.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efdfaffd700 1 -- 172.21.15.105:0/1526774177 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec009a00 con 0x7efdfc0c0060 2020-11-20T11:29:40.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efdfaffd700 1 -- 172.21.15.105:0/1526774177 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec009d80 con 0x7efdfc0c0060 2020-11-20T11:29:40.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 -- 172.21.15.105:0/1526774177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 msgr2=0x7efdfc0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 --2- 172.21.15.105:0/1526774177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc0c0440 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efdfc0ba430 tx=0x7efdec006eb0).stop 2020-11-20T11:29:40.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 -- 172.21.15.105:0/1526774177 shutdown_connections 2020-11-20T11:29:40.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 --2- 172.21.15.105:0/1526774177 >> v2:172.21.15.67:3300/0 conn(0x7efdfc14e390 0x7efdfc14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 --2- 172.21.15.105:0/1526774177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc0c0440 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 -- 172.21.15.105:0/1526774177 >> 172.21.15.105:0/1526774177 conn(0x7efdfc0b9910 msgr2=0x7efdfc0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 -- 172.21.15.105:0/1526774177 shutdown_connections 2020-11-20T11:29:40.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.369+0000 7efe0256b700 1 -- 172.21.15.105:0/1526774177 wait complete. 2020-11-20T11:29:40.380 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.370+0000 7efe0256b700 1 Processor -- start 2020-11-20T11:29:40.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 -- start start 2020-11-20T11:29:40.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdfc0bdda0 0x7efdfc14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 0x7efdfc15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc14bf60 con 0x7efdfc14e390 2020-11-20T11:29:40.382 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0bb520 con 0x7efdfc0bdda0 2020-11-20T11:29:40.382 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efe0256b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0bb7c0 con 0x7efdfc0c0060 2020-11-20T11:29:40.382 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efdfb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.382 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efdfb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41836/0 (socket says 172.21.15.105:41836) 2020-11-20T11:29:40.382 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efdfb7fe700 1 -- 172.21.15.105:0/3001129358 learned_addr learned my addr 172.21.15.105:0/3001129358 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:40.383 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.371+0000 7efdfbfff700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdfc0bdda0 0x7efdfc14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.383 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efe00b08700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 0x7efdfc15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.383 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 -- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdfc0bdda0 msgr2=0x7efdfc14b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.383 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdfc0bdda0 0x7efdfc14b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.383 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 -- 172.21.15.105:0/3001129358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 msgr2=0x7efdfc15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 0x7efdfc15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 -- 172.21.15.105:0/3001129358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0bba60 con 0x7efdfc0c0060 2020-11-20T11:29:40.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efe00b08700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 0x7efdfc15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:40.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efdfb7fe700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7efdf000c710 tx=0x7efdf0007be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000e490 con 0x7efdfc0c0060 2020-11-20T11:29:40.385 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000e5f0 con 0x7efdfc0c0060 2020-11-20T11:29:40.385 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0bbd00 con 0x7efdfc0c0060 2020-11-20T11:29:40.385 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000e990 con 0x7efdfc0c0060 2020-11-20T11:29:40.385 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.372+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc14bc00 con 0x7efdfc0c0060 2020-11-20T11:29:40.385 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.373+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc0bc160 con 0x7efdfc0c0060 2020-11-20T11:29:40.386 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.373+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efdf0019030 con 0x7efdfc0c0060 2020-11-20T11:29:40.386 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.374+0000 7efddbfff700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.386 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.374+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7efdf00a1ec0 con 0x7efdfc0c0060 2020-11-20T11:29:40.386 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.374+0000 7efdfbfff700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.386 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.374+0000 7efdfbfff700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 0x7efdd4082af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7efdec006ef0 tx=0x7efdec015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.387 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.377+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efdf00768d0 con 0x7efdfc0c0060 2020-11-20T11:29:40.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.539+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdfc044f60 con 0x7efdfc0c0060 2020-11-20T11:29:40.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.539+0000 7efddbfff700 1 -- 172.21.15.105:0/3001129358 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdf009fe60 con 0x7efdfc0c0060 2020-11-20T11:29:40.543 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:40.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 msgr2=0x7efdd4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 0x7efdd4082af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7efdec006ef0 tx=0x7efdec015000).stop 2020-11-20T11:29:40.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 msgr2=0x7efdfc146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7efdf000c710 tx=0x7efdf0007be0).stop 2020-11-20T11:29:40.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 shutdown_connections 2020-11-20T11:29:40.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdfc14e390 0x7efdfc15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdfc0bdda0 0x7efdfc14b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 --2- 172.21.15.105:0/3001129358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0c0060 0x7efdfc146e00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 >> 172.21.15.105:0/3001129358 conn(0x7efdfc0b9910 msgr2=0x7efdfc066fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 shutdown_connections 2020-11-20T11:29:40.548 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.541+0000 7efe0256b700 1 -- 172.21.15.105:0/3001129358 wait complete. 2020-11-20T11:29:40.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.1 2020-11-20T11:29:40.556 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T11:29:40.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.673+0000 7fa9ce29e700 1 Processor -- start 2020-11-20T11:29:40.677 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.673+0000 7fa9ce29e700 1 -- start start 2020-11-20T11:29:40.680 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9ce29e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c8067490 con 0x7fa9c814f3f0 2020-11-20T11:29:40.680 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9ce29e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c814fa20 con 0x7fa9c80c3bc0 2020-11-20T11:29:40.680 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9ce29e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c814fcc0 con 0x7fa9c80c37e0 2020-11-20T11:29:40.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c7fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa9c80c37e0 0x7fa9c80c0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41448/0 (socket says 172.21.15.105:41448) 2020-11-20T11:29:40.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c7fff700 1 -- 172.21.15.105:0/3865466558 learned_addr learned my addr 172.21.15.105:0/3865466558 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:40.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020708794 0 0) 0x7fa9c814fcc0 con 0x7fa9c80c37e0 2020-11-20T11:29:40.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b4003240 con 0x7fa9c80c37e0 2020-11-20T11:29:40.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733323196 0 0) 0x7fa9c8067490 con 0x7fa9c814f3f0 2020-11-20T11:29:40.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c814fcc0 con 0x7fa9c814f3f0 2020-11-20T11:29:40.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 977483546 0 0) 0x7fa9b4003240 con 0x7fa9c80c37e0 2020-11-20T11:29:40.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.674+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 >> v1:172.21.15.100:6789/0 conn(0x7fa9c80c3bc0 legacy=0x7fa9c8066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 >> v1:172.21.15.67:6789/0 conn(0x7fa9c814f3f0 legacy=0x7fa9c8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80bfd70 con 0x7fa9c80c37e0 2020-11-20T11:29:40.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fa9b80014e0 con 0x7fa9c80c37e0 2020-11-20T11:29:40.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 >> v1:172.21.15.105:6789/0 conn(0x7fa9c80c37e0 legacy=0x7fa9c80c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b40038c0 0x7fa9b4003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b40044e0 0x7fa9b4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 0x7fa9b400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4005380 con 0x7fa9b40044e0 2020-11-20T11:29:40.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b400bc20 con 0x7fa9b40038c0 2020-11-20T11:29:40.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b400bdb0 con 0x7fa9b4004e50 2020-11-20T11:29:40.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 0x7fa9b400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c7fff700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b40038c0 0x7fa9b4003ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c77fe700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b40044e0 0x7fa9b4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 -- 172.21.15.105:0/3865466558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b40038c0 msgr2=0x7fa9b4003ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b40038c0 0x7fa9b4003ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 -- 172.21.15.105:0/3865466558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b40044e0 msgr2=0x7fa9b4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b40044e0 0x7fa9b4004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 -- 172.21.15.105:0/3865466558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b4003240 con 0x7fa9b4004e50 2020-11-20T11:29:40.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 -- 172.21.15.105:0/3865466558 reap_dead start 2020-11-20T11:29:40.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 0x7fa9b400b730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa9c0002010 tx=0x7fa9c0007ef0).ready entity=mon.2 client_cookie=88918045eeb53ddd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00016d0 con 0x7fa9b4004e50 2020-11-20T11:29:40.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c000cb90 con 0x7fa9b4004e50 2020-11-20T11:29:40.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.675+0000 7fa9c6ffd700 1 -- 172.21.15.105:0/3865466558 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0012400 con 0x7fa9b4004e50 2020-11-20T11:29:40.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 -- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 msgr2=0x7fa9b400b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 0x7fa9b400b730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa9c0002010 tx=0x7fa9c0007ef0).stop 2020-11-20T11:29:40.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 -- 172.21.15.105:0/3865466558 shutdown_connections 2020-11-20T11:29:40.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/3865466558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9b4004e50 0x7fa9b400b730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 -- 172.21.15.105:0/3865466558 >> 172.21.15.105:0/3865466558 conn(0x7fa9c80b9910 msgr2=0x7fa9c80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 -- 172.21.15.105:0/3865466558 shutdown_connections 2020-11-20T11:29:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.676+0000 7fa9ce29e700 1 -- 172.21.15.105:0/3865466558 wait complete. 2020-11-20T11:29:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.677+0000 7fa9ce29e700 1 Processor -- start 2020-11-20T11:29:40.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.677+0000 7fa9ce29e700 1 -- start start 2020-11-20T11:29:40.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b4004e50 0x7fa9c8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9c8142cb0 0x7fa9c8143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8145c80 con 0x7fa9c8142cb0 2020-11-20T11:29:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c81452f0 con 0x7fa9b4004e50 2020-11-20T11:29:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c81454e0 con 0x7fa9c81551d0 2020-11-20T11:29:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41860/0 (socket says 172.21.15.105:41860) 2020-11-20T11:29:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 -- 172.21.15.105:0/1412263117 learned_addr learned my addr 172.21.15.105:0/1412263117 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9c77fe700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9c8142cb0 0x7fa9c8143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9c7fff700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b4004e50 0x7fa9c8154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 -- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b4004e50 msgr2=0x7fa9c8154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b4004e50 0x7fa9c8154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 -- 172.21.15.105:0/1412263117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9c8142cb0 msgr2=0x7fa9c8143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9c8142cb0 0x7fa9c8143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 -- 172.21.15.105:0/1412263117 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8154c60 con 0x7fa9c81551d0 2020-11-20T11:29:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9cc83b700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa9c0001f30 tx=0x7fa9c0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0020070 con 0x7fa9c81551d0 2020-11-20T11:29:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0006870 con 0x7fa9c81551d0 2020-11-20T11:29:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c8143d00 con 0x7fa9c81551d0 2020-11-20T11:29:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0006c30 con 0x7fa9c81551d0 2020-11-20T11:29:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.678+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c81459e0 con 0x7fa9c81551d0 2020-11-20T11:29:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.679+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c8154ed0 con 0x7fa9c81551d0 2020-11-20T11:29:40.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.680+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa9c0010070 con 0x7fa9c81551d0 2020-11-20T11:29:40.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.680+0000 7fa9a7fff700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 0x7fa9a0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.681+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa9c00a3910 con 0x7fa9c81551d0 2020-11-20T11:29:40.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.681+0000 7fa9c7fff700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 0x7fa9a0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.681+0000 7fa9c7fff700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 0x7fa9a0082af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa9b8000dd0 tx=0x7fa9c80bff00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.697 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.684+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa9c00782a0 con 0x7fa9c81551d0 2020-11-20T11:29:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.849+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9c8044f60 con 0x7fa9c81551d0 2020-11-20T11:29:40.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.849+0000 7fa9a7fff700 1 -- 172.21.15.105:0/1412263117 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9c007b8c0 con 0x7fa9c81551d0 2020-11-20T11:29:40.853 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:40.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 msgr2=0x7fa9a0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 0x7fa9a0082af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa9b8000dd0 tx=0x7fa9c80bff00).stop 2020-11-20T11:29:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 msgr2=0x7fa9c8155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa9c0001f30 tx=0x7fa9c0017000).stop 2020-11-20T11:29:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 shutdown_connections 2020-11-20T11:29:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa9a0080630 0x7fa9a0082af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9c81551d0 0x7fa9c8155650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b4004e50 0x7fa9c8154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 --2- 172.21.15.105:0/1412263117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9c8142cb0 0x7fa9c8143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 >> 172.21.15.105:0/1412263117 conn(0x7fa9c80b9910 msgr2=0x7fa9c8061c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 shutdown_connections 2020-11-20T11:29:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.851+0000 7fa9ce29e700 1 -- 172.21.15.105:0/1412263117 wait complete. 2020-11-20T11:29:40.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.2 2020-11-20T11:29:40.865 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T11:29:40.984 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.980+0000 7fb398768700 1 Processor -- start 2020-11-20T11:29:40.984 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.980+0000 7fb398768700 1 -- start start 2020-11-20T11:29:40.988 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb398768700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3900c37e0 0x7fb3900c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.988 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb398768700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3900bfdd0 0x7fb3900c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.988 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb398768700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39014e210 con 0x7fb39014af60 2020-11-20T11:29:40.988 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb398768700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39014e4b0 con 0x7fb3900bfdd0 2020-11-20T11:29:40.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb398768700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39014e750 con 0x7fb3900c37e0 2020-11-20T11:29:40.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb395d03700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb39014af60 0x7fb39014b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41468/0 (socket says 172.21.15.105:41468) 2020-11-20T11:29:40.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.981+0000 7fb395d03700 1 -- 172.21.15.105:0/1054831649 learned_addr learned my addr 172.21.15.105:0/1054831649 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:40.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396504700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.100:3300/0 conn(0x7fb3900c37e0 0x7fb3900c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.989 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396d05700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.67:3300/0 conn(0x7fb3900bfdd0 0x7fb3900c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888509947 0 0) 0x7fb39014e210 con 0x7fb39014af60 2020-11-20T11:29:40.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb378003240 con 0x7fb39014af60 2020-11-20T11:29:40.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3085861264 0 0) 0x7fb378003240 con 0x7fb39014af60 2020-11-20T11:29:40.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 >> v2:172.21.15.100:3300/0 conn(0x7fb3900c37e0 msgr2=0x7fb3900c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.990 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.100:3300/0 conn(0x7fb3900c37e0 0x7fb3900c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 >> v2:172.21.15.67:3300/0 conn(0x7fb3900bfdd0 msgr2=0x7fb3900c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.67:3300/0 conn(0x7fb3900bfdd0 0x7fb3900c0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39014e9f0 con 0x7fb39014af60 2020-11-20T11:29:40.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fb38c0014e0 con 0x7fb39014af60 2020-11-20T11:29:40.991 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396d05700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.67:3300/0 conn(0x7fb3900bfdd0 0x7fb3900c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:40.992 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396504700 1 --2- 172.21.15.105:0/1054831649 >> v2:172.21.15.100:3300/0 conn(0x7fb3900c37e0 0x7fb3900c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:29:40.992 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 >> v1:172.21.15.105:6789/0 conn(0x7fb39014af60 legacy=0x7fb39014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.992 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb378003780 0x7fb378003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.992 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 0x7fb378004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.992 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378004e50 0x7fb37800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:40.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39014e4b0 con 0x7fb378003780 2020-11-20T11:29:40.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39014e750 con 0x7fb378004e50 2020-11-20T11:29:40.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378005300 con 0x7fb3780044e0 2020-11-20T11:29:40.993 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 0x7fb378004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396504700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb378003780 0x7fb378003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396d05700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378004e50 0x7fb37800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:40.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 -- 172.21.15.105:0/1054831649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378004e50 msgr2=0x7fb37800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378004e50 0x7fb37800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.994 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 -- 172.21.15.105:0/1054831649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb378003780 msgr2=0x7fb378003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:40.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb378003780 0x7fb378003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb395d03700 1 -- 172.21.15.105:0/1054831649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378003240 con 0x7fb3780044e0 2020-11-20T11:29:40.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.982+0000 7fb396d05700 1 -- 172.21.15.105:0/1054831649 reap_dead start 2020-11-20T11:29:40.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb395d03700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 0x7fb378004960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb38c0010d0 tx=0x7fb38c007800).ready entity=mon.2 client_cookie=19a08f0c919ea50 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:40.995 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0070d0 con 0x7fb3780044e0 2020-11-20T11:29:40.996 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c007230 con 0x7fb3780044e0 2020-11-20T11:29:40.996 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb395502700 1 -- 172.21.15.105:0/1054831649 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0055f0 con 0x7fb3780044e0 2020-11-20T11:29:40.996 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 -- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 msgr2=0x7fb378004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:40.996 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 0x7fb378004960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb38c0010d0 tx=0x7fb38c007800).stop 2020-11-20T11:29:40.996 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 -- 172.21.15.105:0/1054831649 shutdown_connections 2020-11-20T11:29:40.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 --2- 172.21.15.105:0/1054831649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3780044e0 0x7fb378004960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:40.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 -- 172.21.15.105:0/1054831649 >> 172.21.15.105:0/1054831649 conn(0x7fb3900b9910 msgr2=0x7fb3900b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:40.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 -- 172.21.15.105:0/1054831649 shutdown_connections 2020-11-20T11:29:40.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.983+0000 7fb398768700 1 -- 172.21.15.105:0/1054831649 wait complete. 2020-11-20T11:29:40.997 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.984+0000 7fb398768700 1 Processor -- start 2020-11-20T11:29:40.998 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.984+0000 7fb398768700 1 -- start start 2020-11-20T11:29:41.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 0x7fb39015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39008fab0 0x7fb3900bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39009bd10 con 0x7fb39008fab0 2020-11-20T11:29:41.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39015cf10 con 0x7fb3780044e0 2020-11-20T11:29:41.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb398768700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39014c5c0 con 0x7fb390149090 2020-11-20T11:29:41.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41878/0 (socket says 172.21.15.105:41878) 2020-11-20T11:29:41.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 -- 172.21.15.105:0/4099152794 learned_addr learned my addr 172.21.15.105:0/4099152794 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:41.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb396504700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 0x7fb39015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb396d05700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39008fab0 0x7fb3900bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 -- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 msgr2=0x7fb39015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 0x7fb39015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 -- 172.21.15.105:0/4099152794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39008fab0 msgr2=0x7fb3900bc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39008fab0 0x7fb3900bc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 -- 172.21.15.105:0/4099152794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39014c860 con 0x7fb390149090 2020-11-20T11:29:41.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb396504700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 0x7fb39015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.985+0000 7fb395d03700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb38c007150 tx=0x7fb38c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.986+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c005b70 con 0x7fb390149090 2020-11-20T11:29:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.986+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c005cd0 con 0x7fb390149090 2020-11-20T11:29:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.986+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39014cb00 con 0x7fb390149090 2020-11-20T11:29:41.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.986+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0116c0 con 0x7fb390149090 2020-11-20T11:29:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.986+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39014d040 con 0x7fb390149090 2020-11-20T11:29:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.987+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39008fe90 con 0x7fb390149090 2020-11-20T11:29:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.987+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb38c023020 con 0x7fb390149090 2020-11-20T11:29:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.988+0000 7fb37e7fc700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 0x7fb368082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.988+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb38c0a5d30 con 0x7fb390149090 2020-11-20T11:29:41.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.988+0000 7fb396504700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 0x7fb368082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.988+0000 7fb396504700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 0x7fb368082af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb380006fd0 tx=0x7fb380008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:40.991+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb38c07a740 con 0x7fb390149090 2020-11-20T11:29:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.155+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb390044f60 con 0x7fb390149090 2020-11-20T11:29:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.155+0000 7fb37e7fc700 1 -- 172.21.15.105:0/4099152794 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb38c07dd60 con 0x7fb390149090 2020-11-20T11:29:41.159 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 msgr2=0x7fb368082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 0x7fb368082af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb380006fd0 tx=0x7fb380008040).stop 2020-11-20T11:29:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 msgr2=0x7fb39008f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb38c007150 tx=0x7fb38c017000).stop 2020-11-20T11:29:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 shutdown_connections 2020-11-20T11:29:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39008fab0 0x7fb3900bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3780044e0 0x7fb39015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb368080630 0x7fb368082af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 --2- 172.21.15.105:0/4099152794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb390149090 0x7fb39008f5c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 >> 172.21.15.105:0/4099152794 conn(0x7fb3900b9910 msgr2=0x7fb3900beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 shutdown_connections 2020-11-20T11:29:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.157+0000 7fb398768700 1 -- 172.21.15.105:0/4099152794 wait complete. 2020-11-20T11:29:41.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.3 2020-11-20T11:29:41.172 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T11:29:41.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.285+0000 7f1f21e47700 1 Processor -- start 2020-11-20T11:29:41.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.285+0000 7f1f21e47700 1 -- start start 2020-11-20T11:29:41.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f21e47700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f21e47700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f1c066d80 0x7f1f1c14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f21e47700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c14fa20 con 0x7f1f1c065160 2020-11-20T11:29:41.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f21e47700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c14fcc0 con 0x7f1f1c066d80 2020-11-20T11:29:41.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f21e47700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c0bfd70 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f1b7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f1b7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41884/0 (socket says 172.21.15.105:41884) 2020-11-20T11:29:41.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.286+0000 7f1f1b7fe700 1 -- 172.21.15.105:0/3676093831 learned_addr learned my addr 172.21.15.105:0/3676093831 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:41.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1bfff700 1 --2- 172.21.15.105:0/3676093831 >> v2:172.21.15.67:3300/0 conn(0x7f1f1c066d80 0x7f1f1c14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1b7fe700 1 -- 172.21.15.105:0/3676093831 >> v2:172.21.15.67:3300/0 conn(0x7f1f1c066d80 msgr2=0x7f1f1c14e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:41.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1b7fe700 1 --2- 172.21.15.105:0/3676093831 >> v2:172.21.15.67:3300/0 conn(0x7f1f1c066d80 0x7f1f1c14e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1b7fe700 1 -- 172.21.15.105:0/3676093831 >> v1:172.21.15.67:6789/0 conn(0x7f1f1c065160 legacy=0x7f1f1c0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:41.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1b7fe700 1 -- 172.21.15.105:0/3676093831 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0c0010 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1b7fe700 1 --2- 172.21.15.105:0/3676093831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1f1c026ab0 tx=0x7f1f0c009290).ready entity=mon.2 client_cookie=a0207db269b91ce4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1a7fc700 1 -- 172.21.15.105:0/3676093831 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00bc10 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1a7fc700 1 -- 172.21.15.105:0/3676093831 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c00bd70 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f1a7fc700 1 -- 172.21.15.105:0/3676093831 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c011610 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 -- 172.21.15.105:0/3676093831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 msgr2=0x7f1f1c0c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 --2- 172.21.15.105:0/3676093831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1f1c026ab0 tx=0x7f1f0c009290).stop 2020-11-20T11:29:41.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 -- 172.21.15.105:0/3676093831 shutdown_connections 2020-11-20T11:29:41.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 --2- 172.21.15.105:0/3676093831 >> v2:172.21.15.67:3300/0 conn(0x7f1f1c066d80 0x7f1f1c14e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 --2- 172.21.15.105:0/3676093831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c0c3bc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 -- 172.21.15.105:0/3676093831 >> 172.21.15.105:0/3676093831 conn(0x7f1f1c0b9910 msgr2=0x7f1f1c0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 -- 172.21.15.105:0/3676093831 shutdown_connections 2020-11-20T11:29:41.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.287+0000 7f1f21e47700 1 -- 172.21.15.105:0/3676093831 wait complete. 2020-11-20T11:29:41.298 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 Processor -- start 2020-11-20T11:29:41.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 -- start start 2020-11-20T11:29:41.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1c065160 0x7f1f1c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f1c066d80 0x7f1f1c14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.299 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c153470 con 0x7f1f1c065160 2020-11-20T11:29:41.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c150980 con 0x7f1f1c066d80 2020-11-20T11:29:41.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f21e47700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c161c30 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f1bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.289+0000 7f1f1bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41890/0 (socket says 172.21.15.105:41890) 2020-11-20T11:29:41.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 -- 172.21.15.105:0/2038709450 learned_addr learned my addr 172.21.15.105:0/2038709450 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:41.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1affd700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f1c066d80 0x7f1f1c14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1b7fe700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1c065160 0x7f1f1c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 -- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f1c066d80 msgr2=0x7f1f1c14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f1c066d80 0x7f1f1c14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 -- 172.21.15.105:0/2038709450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1c065160 msgr2=0x7f1f1c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.302 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1c065160 0x7f1f1c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.302 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 -- 172.21.15.105:0/2038709450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0c2a30 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.302 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f1bfff700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1f1400c7d0 tx=0x7f1f14008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.302 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007630 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.302 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f14007790 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c0c2cd0 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007b30 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.290+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c152e50 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.291+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c044f60 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.292+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1f14011410 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.292+0000 7f1efb7fe700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 0x7f1ef4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.292+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1f140a37b0 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.293+0000 7f1f1b7fe700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 0x7f1ef4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.293+0000 7f1f1b7fe700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 0x7f1ef4082af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1f0c0090f0 tx=0x7f1f0c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.295+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1f140780e0 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.327 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:41.330 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:41.333 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:41.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.464+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1f1c161d70 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.464+0000 7f1efb7fe700 1 -- 172.21.15.105:0/2038709450 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f1407b700 con 0x7f1f1c0c37e0 2020-11-20T11:29:41.468 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:41.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.465+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 msgr2=0x7f1ef4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.465+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 0x7f1ef4082af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1f0c0090f0 tx=0x7f1f0c016000).stop 2020-11-20T11:29:41.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.465+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 msgr2=0x7f1f1c162090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.465+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1f1400c7d0 tx=0x7f1f14008040).stop 2020-11-20T11:29:41.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 shutdown_connections 2020-11-20T11:29:41.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1ef4080630 0x7f1ef4082af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c0c37e0 0x7f1f1c162090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1c065160 0x7f1f1c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 --2- 172.21.15.105:0/2038709450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f1c066d80 0x7f1f1c14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 >> 172.21.15.105:0/2038709450 conn(0x7f1f1c0b9910 msgr2=0x7f1f1c062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.471 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 shutdown_connections 2020-11-20T11:29:41.472 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.466+0000 7f1f21e47700 1 -- 172.21.15.105:0/2038709450 wait complete. 2020-11-20T11:29:41.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.4 2020-11-20T11:29:41.480 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T11:29:41.604 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.595+0000 7fb8fe47d700 1 Processor -- start 2020-11-20T11:29:41.604 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.595+0000 7fb8fe47d700 1 -- start start 2020-11-20T11:29:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.596+0000 7fb8fe47d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8f81518e0 0x7fb8f80c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.596+0000 7fb8fe47d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8061d20 con 0x7fb8f80bfd60 2020-11-20T11:29:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.596+0000 7fb8fe47d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f814d790 con 0x7fb8f814dbc0 2020-11-20T11:29:41.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.596+0000 7fb8fe47d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80be1c0 con 0x7fb8f81518e0 2020-11-20T11:29:41.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f77fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8f81518e0 0x7fb8f80c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8fca1a700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8f814dbc0 0x7fb8f814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60514/0 (socket says 172.21.15.105:60514) 2020-11-20T11:29:41.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8fca1a700 1 -- 172.21.15.105:0/1795989350 learned_addr learned my addr 172.21.15.105:0/1795989350 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:41.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f77fe700 1 -- 172.21.15.105:0/1795989350 >> v1:172.21.15.100:6789/0 conn(0x7fb8f814dbc0 legacy=0x7fb8f814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f6ffd700 1 -- 172.21.15.105:0/1795989350 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227649835 0 0) 0x7fb8f8061d20 con 0x7fb8f80bfd60 2020-11-20T11:29:41.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f77fe700 1 -- 172.21.15.105:0/1795989350 >> v1:172.21.15.67:6789/0 conn(0x7fb8f80bfd60 legacy=0x7fb8f8067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f77fe700 1 -- 172.21.15.105:0/1795989350 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80be460 con 0x7fb8f81518e0 2020-11-20T11:29:41.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f77fe700 1 --2- 172.21.15.105:0/1795989350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f81518e0 0x7fb8f80c0140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8ec00b920 tx=0x7fb8ec006df0).ready entity=mon.1 client_cookie=44336504038d8bb6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f6ffd700 1 -- 172.21.15.105:0/1795989350 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec009730 con 0x7fb8f81518e0 2020-11-20T11:29:41.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f6ffd700 1 -- 172.21.15.105:0/1795989350 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec009890 con 0x7fb8f81518e0 2020-11-20T11:29:41.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.597+0000 7fb8f6ffd700 1 -- 172.21.15.105:0/1795989350 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec009c10 con 0x7fb8f81518e0 2020-11-20T11:29:41.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 -- 172.21.15.105:0/1795989350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f81518e0 msgr2=0x7fb8f80c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/1795989350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f81518e0 0x7fb8f80c0140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8ec00b920 tx=0x7fb8ec006df0).stop 2020-11-20T11:29:41.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 -- 172.21.15.105:0/1795989350 shutdown_connections 2020-11-20T11:29:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/1795989350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f81518e0 0x7fb8f80c0140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 -- 172.21.15.105:0/1795989350 >> 172.21.15.105:0/1795989350 conn(0x7fb8f80b9910 msgr2=0x7fb8f80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 -- 172.21.15.105:0/1795989350 shutdown_connections 2020-11-20T11:29:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.598+0000 7fb8fe47d700 1 -- 172.21.15.105:0/1795989350 wait complete. 2020-11-20T11:29:41.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.599+0000 7fb8fe47d700 1 Processor -- start 2020-11-20T11:29:41.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.599+0000 7fb8fe47d700 1 -- start start 2020-11-20T11:29:41.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f80bfd60 0x7fb8f815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f814dbc0 0x7fb8f8092160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f815d000 con 0x7fb8f814dbc0 2020-11-20T11:29:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f815d660 con 0x7fb8f80bfd60 2020-11-20T11:29:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f815d900 con 0x7fb8f81518e0 2020-11-20T11:29:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41902/0 (socket says 172.21.15.105:41902) 2020-11-20T11:29:41.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 -- 172.21.15.105:0/2526216115 learned_addr learned my addr 172.21.15.105:0/2526216115 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:41.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8f77fe700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f814dbc0 0x7fb8f8092160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8f7fff700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f80bfd60 0x7fb8f815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 -- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f80bfd60 msgr2=0x7fb8f815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f80bfd60 0x7fb8f815cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.613 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 -- 172.21.15.105:0/2526216115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f814dbc0 msgr2=0x7fb8f8092160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.613 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f814dbc0 0x7fb8f8092160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.613 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 -- 172.21.15.105:0/2526216115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f815dba0 con 0x7fb8f81518e0 2020-11-20T11:29:41.613 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fca1a700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb8f000cb50 tx=0x7fb8f0007f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.614 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0005b80 con 0x7fb8f81518e0 2020-11-20T11:29:41.614 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0005ce0 con 0x7fb8f81518e0 2020-11-20T11:29:41.614 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0007320 con 0x7fb8f81518e0 2020-11-20T11:29:41.614 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.600+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f815de40 con 0x7fb8f81518e0 2020-11-20T11:29:41.615 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.601+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f809b5b0 con 0x7fb8f81518e0 2020-11-20T11:29:41.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.601+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8044f60 con 0x7fb8f81518e0 2020-11-20T11:29:41.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.602+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb8f0010030 con 0x7fb8f81518e0 2020-11-20T11:29:41.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.603+0000 7fb8dffff700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 0x7fb8d4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.603+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb8f00a2bf0 con 0x7fb8f81518e0 2020-11-20T11:29:41.616 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.603+0000 7fb8f7fff700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 0x7fb8d4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.603+0000 7fb8f7fff700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 0x7fb8d4082b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb8e80011a0 tx=0x7fb8e80079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.606+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb8f0077600 con 0x7fb8f81518e0 2020-11-20T11:29:41.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.769+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb8f8062a90 con 0x7fb8f81518e0 2020-11-20T11:29:41.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.770+0000 7fb8dffff700 1 -- 172.21.15.105:0/2526216115 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8f007ac20 con 0x7fb8f81518e0 2020-11-20T11:29:41.774 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:41.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 msgr2=0x7fb8d4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 0x7fb8d4082b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb8e80011a0 tx=0x7fb8e80079b0).stop 2020-11-20T11:29:41.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 msgr2=0x7fb8f8150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb8f000cb50 tx=0x7fb8f0007f00).stop 2020-11-20T11:29:41.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 shutdown_connections 2020-11-20T11:29:41.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb8d4080660 0x7fb8d4082b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8f81518e0 0x7fb8f8150dd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f80bfd60 0x7fb8f815cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 --2- 172.21.15.105:0/2526216115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f814dbc0 0x7fb8f8092160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 >> 172.21.15.105:0/2526216115 conn(0x7fb8f80b9910 msgr2=0x7fb8f80c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 shutdown_connections 2020-11-20T11:29:41.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.771+0000 7fb8fe47d700 1 -- 172.21.15.105:0/2526216115 wait complete. 2020-11-20T11:29:41.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.5 2020-11-20T11:29:41.790 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T11:29:41.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.910+0000 7f1de7694700 1 Processor -- start 2020-11-20T11:29:41.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 -- start start 2020-11-20T11:29:41.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1de0151330 0x7f1de00c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1de01552a0 0x7f1de009dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0151870 con 0x7f1de00c01c0 2020-11-20T11:29:41.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de009e200 con 0x7f1de01552a0 2020-11-20T11:29:41.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.911+0000 7f1de7694700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de0155730 con 0x7f1de0151330 2020-11-20T11:29:41.917 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1de0151330 0x7f1de00c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de5430700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1de00c01c0 0x7f1de009bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60526/0 (socket says 172.21.15.105:60526) 2020-11-20T11:29:41.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de5c31700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1de01552a0 0x7f1de009dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1de0151330 0x7f1de00c05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60034/0 (socket says 172.21.15.105:60034) 2020-11-20T11:29:41.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de5430700 1 -- 172.21.15.105:0/4076799631 learned_addr learned my addr 172.21.15.105:0/4076799631 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:41.918 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 -- 172.21.15.105:0/4076799631 >> v2:172.21.15.67:3300/0 conn(0x7f1de01552a0 msgr2=0x7f1de009dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:41.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 --2- 172.21.15.105:0/4076799631 >> v2:172.21.15.67:3300/0 conn(0x7f1de01552a0 0x7f1de009dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 -- 172.21.15.105:0/4076799631 >> v1:172.21.15.100:6789/0 conn(0x7f1de00c01c0 legacy=0x7f1de009bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1dcffff700 1 -- 172.21.15.105:0/4076799631 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153557023 0 0) 0x7f1de0151870 con 0x7f1de00c01c0 2020-11-20T11:29:41.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 -- 172.21.15.105:0/4076799631 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0151b10 con 0x7f1de0151330 2020-11-20T11:29:41.919 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1de4c2f700 1 --2- 172.21.15.105:0/4076799631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de0151330 0x7f1de00c05a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1de00bfc10 tx=0x7f1ddc006df0).ready entity=mon.1 client_cookie=3fb8bc7473d6dbd6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1dcffff700 1 -- 172.21.15.105:0/4076799631 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0097b0 con 0x7f1de0151330 2020-11-20T11:29:41.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1dcffff700 1 -- 172.21.15.105:0/4076799631 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc009910 con 0x7f1de0151330 2020-11-20T11:29:41.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.912+0000 7f1dcffff700 1 -- 172.21.15.105:0/4076799631 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc009c90 con 0x7f1de0151330 2020-11-20T11:29:41.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 -- 172.21.15.105:0/4076799631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de0151330 msgr2=0x7f1de00c05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.920 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 --2- 172.21.15.105:0/4076799631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de0151330 0x7f1de00c05a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1de00bfc10 tx=0x7f1ddc006df0).stop 2020-11-20T11:29:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 -- 172.21.15.105:0/4076799631 shutdown_connections 2020-11-20T11:29:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 --2- 172.21.15.105:0/4076799631 >> v2:172.21.15.67:3300/0 conn(0x7f1de01552a0 0x7f1de009dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 --2- 172.21.15.105:0/4076799631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de0151330 0x7f1de00c05a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 -- 172.21.15.105:0/4076799631 >> 172.21.15.105:0/4076799631 conn(0x7f1de0025a60 msgr2=0x7f1de0025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:41.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 -- 172.21.15.105:0/4076799631 shutdown_connections 2020-11-20T11:29:41.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.913+0000 7f1de7694700 1 -- 172.21.15.105:0/4076799631 wait complete. 2020-11-20T11:29:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.914+0000 7f1de7694700 1 Processor -- start 2020-11-20T11:29:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.914+0000 7f1de7694700 1 -- start start 2020-11-20T11:29:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c01c0 0x7f1de01529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de0151330 0x7f1de00625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de009b470 con 0x7f1de0151330 2020-11-20T11:29:41.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0061c80 con 0x7f1de00c01c0 2020-11-20T11:29:41.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de7694700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0063fc0 con 0x7f1de01552a0 2020-11-20T11:29:41.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41916/0 (socket says 172.21.15.105:41916) 2020-11-20T11:29:41.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 -- 172.21.15.105:0/1420571170 learned_addr learned my addr 172.21.15.105:0/1420571170 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:41.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5430700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c01c0 0x7f1de01529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de4c2f700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de0151330 0x7f1de00625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 -- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c01c0 msgr2=0x7f1de01529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c01c0 0x7f1de01529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 -- 172.21.15.105:0/1420571170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de0151330 msgr2=0x7f1de00625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:41.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de0151330 0x7f1de00625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:41.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 -- 172.21.15.105:0/1420571170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0064220 con 0x7f1de01552a0 2020-11-20T11:29:41.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1de5c31700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1dd800ef80 tx=0x7f1dd80091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.915+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800cbc0 con 0x7f1de01552a0 2020-11-20T11:29:41.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.916+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800cd20 con 0x7f1de01552a0 2020-11-20T11:29:41.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.916+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00644c0 con 0x7f1de01552a0 2020-11-20T11:29:41.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.916+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8012620 con 0x7f1de01552a0 2020-11-20T11:29:41.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.916+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de0061eb0 con 0x7f1de01552a0 2020-11-20T11:29:41.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.917+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0044f60 con 0x7f1de01552a0 2020-11-20T11:29:41.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.917+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1dd8022070 con 0x7f1de01552a0 2020-11-20T11:29:41.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.918+0000 7f1dcd7fa700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 0x7f1db8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:41.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.918+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1dd80a3250 con 0x7f1de01552a0 2020-11-20T11:29:41.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.918+0000 7f1de5430700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 0x7f1db8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:41.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.918+0000 7f1de5430700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 0x7f1db8082af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1dd0000bc0 tx=0x7f1dd0007c00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:41.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:41.921+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1dd8077c60 con 0x7f1de01552a0 2020-11-20T11:29:42.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.087+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1de0026700 con 0x7f1de01552a0 2020-11-20T11:29:42.091 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.087+0000 7f1dcd7fa700 1 -- 172.21.15.105:0/1420571170 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dd8016020 con 0x7f1de01552a0 2020-11-20T11:29:42.091 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:42.092 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 msgr2=0x7f1db8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 0x7f1db8082af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1dd0000bc0 tx=0x7f1dd0007c00).stop 2020-11-20T11:29:42.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 msgr2=0x7f1de014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1dd800ef80 tx=0x7f1dd80091d0).stop 2020-11-20T11:29:42.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 shutdown_connections 2020-11-20T11:29:42.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1db8080630 0x7f1db8082af0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01552a0 0x7f1de014df30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c01c0 0x7f1de01529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 --2- 172.21.15.105:0/1420571170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de0151330 0x7f1de00625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 >> 172.21.15.105:0/1420571170 conn(0x7f1de0025a60 msgr2=0x7f1de00bebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 shutdown_connections 2020-11-20T11:29:42.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.089+0000 7f1de7694700 1 -- 172.21.15.105:0/1420571170 wait complete. 2020-11-20T11:29:42.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.6 2020-11-20T11:29:42.104 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T11:29:42.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.219+0000 7ff294cd4700 1 Processor -- start 2020-11-20T11:29:42.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.219+0000 7ff294cd4700 1 -- start start 2020-11-20T11:29:42.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff294cd4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff290151870 0x7ff290151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff294cd4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff290064160 con 0x7ff29014b1c0 2020-11-20T11:29:42.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff294cd4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff290067320 con 0x7ff290063cb0 2020-11-20T11:29:42.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff294cd4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2900675c0 con 0x7ff290151870 2020-11-20T11:29:42.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff287fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff290063cb0 0x7ff2900667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60544/0 (socket says 172.21.15.105:60544) 2020-11-20T11:29:42.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff287fff700 1 -- 172.21.15.105:0/2514002038 learned_addr learned my addr 172.21.15.105:0/2514002038 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:42.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.220+0000 7ff28e59c700 1 --2- 172.21.15.105:0/2514002038 >> v2:172.21.15.67:3300/0 conn(0x7ff290151870 0x7ff290151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28dd9b700 1 -- 172.21.15.105:0/2514002038 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590826895 0 0) 0x7ff290067320 con 0x7ff290063cb0 2020-11-20T11:29:42.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28dd9b700 1 -- 172.21.15.105:0/2514002038 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff270003240 con 0x7ff290063cb0 2020-11-20T11:29:42.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28e59c700 1 -- 172.21.15.105:0/2514002038 >> v1:172.21.15.100:6789/0 conn(0x7ff290063cb0 legacy=0x7ff2900667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28e59c700 1 -- 172.21.15.105:0/2514002038 >> v1:172.21.15.67:6789/0 conn(0x7ff29014b1c0 legacy=0x7ff29014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.233 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28e59c700 1 -- 172.21.15.105:0/2514002038 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290067860 con 0x7ff290151870 2020-11-20T11:29:42.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28e59c700 1 --2- 172.21.15.105:0/2514002038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290151870 0x7ff290151c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff28000b9a0 tx=0x7ff280006df0).ready entity=mon.0 client_cookie=263672c3e8782327 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28dd9b700 1 -- 172.21.15.105:0/2514002038 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280009840 con 0x7ff290151870 2020-11-20T11:29:42.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28dd9b700 1 -- 172.21.15.105:0/2514002038 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2800099a0 con 0x7ff290151870 2020-11-20T11:29:42.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff28dd9b700 1 -- 172.21.15.105:0/2514002038 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280009d20 con 0x7ff290151870 2020-11-20T11:29:42.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 -- 172.21.15.105:0/2514002038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290151870 msgr2=0x7ff290151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 --2- 172.21.15.105:0/2514002038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290151870 0x7ff290151c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff28000b9a0 tx=0x7ff280006df0).stop 2020-11-20T11:29:42.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 -- 172.21.15.105:0/2514002038 shutdown_connections 2020-11-20T11:29:42.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 --2- 172.21.15.105:0/2514002038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290151870 0x7ff290151c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.235 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 -- 172.21.15.105:0/2514002038 >> 172.21.15.105:0/2514002038 conn(0x7ff2900c4500 msgr2=0x7ff2900c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 -- 172.21.15.105:0/2514002038 shutdown_connections 2020-11-20T11:29:42.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.221+0000 7ff294cd4700 1 -- 172.21.15.105:0/2514002038 wait complete. 2020-11-20T11:29:42.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.222+0000 7ff294cd4700 1 Processor -- start 2020-11-20T11:29:42.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 -- start start 2020-11-20T11:29:42.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290063cb0 0x7ff290145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff290151870 0x7ff29015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290160e00 con 0x7ff290063cb0 2020-11-20T11:29:42.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290146660 con 0x7ff290151870 2020-11-20T11:29:42.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff294cd4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290146900 con 0x7ff29014b1c0 2020-11-20T11:29:42.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff287fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff287fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41930/0 (socket says 172.21.15.105:41930) 2020-11-20T11:29:42.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff287fff700 1 -- 172.21.15.105:0/3409947058 learned_addr learned my addr 172.21.15.105:0/3409947058 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:42.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff28ed9d700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff290151870 0x7ff29015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.223+0000 7ff28e59c700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290063cb0 0x7ff290145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 -- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff290151870 msgr2=0x7ff29015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff290151870 0x7ff29015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 -- 172.21.15.105:0/3409947058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290063cb0 msgr2=0x7ff290145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290063cb0 0x7ff290145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 -- 172.21.15.105:0/3409947058 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290161030 con 0x7ff29014b1c0 2020-11-20T11:29:42.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff287fff700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ff27800c6f0 tx=0x7ff278007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780072e0 con 0x7ff29014b1c0 2020-11-20T11:29:42.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278007440 con 0x7ff29014b1c0 2020-11-20T11:29:42.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2901612d0 con 0x7ff29014b1c0 2020-11-20T11:29:42.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278005800 con 0x7ff29014b1c0 2020-11-20T11:29:42.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.224+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff290145960 con 0x7ff29014b1c0 2020-11-20T11:29:42.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.225+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2900bc740 con 0x7ff29014b1c0 2020-11-20T11:29:42.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.225+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff278010070 con 0x7ff29014b1c0 2020-11-20T11:29:42.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.226+0000 7ff2867fc700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 0x7ff26c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.226+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff2780a2140 con 0x7ff29014b1c0 2020-11-20T11:29:42.243 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.226+0000 7ff28e59c700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 0x7ff26c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.243 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.226+0000 7ff28e59c700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 0x7ff26c082b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff280006e30 tx=0x7ff280015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.243 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.229+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff278076b50 con 0x7ff29014b1c0 2020-11-20T11:29:42.398 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.394+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff2900bb3c0 con 0x7ff29014b1c0 2020-11-20T11:29:42.398 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.394+0000 7ff2867fc700 1 -- 172.21.15.105:0/3409947058 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff27807a170 con 0x7ff29014b1c0 2020-11-20T11:29:42.398 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:42.400 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 msgr2=0x7ff26c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 0x7ff26c082b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff280006e30 tx=0x7ff280015000).stop 2020-11-20T11:29:42.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 msgr2=0x7ff29014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ff27800c6f0 tx=0x7ff278007ad0).stop 2020-11-20T11:29:42.401 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 shutdown_connections 2020-11-20T11:29:42.402 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff290151870 0x7ff29015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.402 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff290063cb0 0x7ff290145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.402 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff26c080660 0x7ff26c082b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.402 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 --2- 172.21.15.105:0/3409947058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff29014b1c0 0x7ff29014b930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.403 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.396+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 >> 172.21.15.105:0/3409947058 conn(0x7ff2900c4500 msgr2=0x7ff2900bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.403 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.397+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 shutdown_connections 2020-11-20T11:29:42.403 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.397+0000 7ff294cd4700 1 -- 172.21.15.105:0/3409947058 wait complete. 2020-11-20T11:29:42.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.7 2020-11-20T11:29:42.411 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T11:29:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.527+0000 7fa5f1794700 1 Processor -- start 2020-11-20T11:29:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.527+0000 7fa5f1794700 1 -- start start 2020-11-20T11:29:42.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5f1794700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5ec0c37e0 0x7fa5ec0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5f1794700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec0bf560 con 0x7fa5ec1525c0 2020-11-20T11:29:42.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5f1794700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec14ff20 con 0x7fa5ec14fae0 2020-11-20T11:29:42.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5f1794700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec152ef0 con 0x7fa5ec0c37e0 2020-11-20T11:29:42.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5ea7fc700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa5ec14fae0 0x7fa5ec0bfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41538/0 (socket says 172.21.15.105:41538) 2020-11-20T11:29:42.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5ea7fc700 1 -- 172.21.15.105:0/1514979559 learned_addr learned my addr 172.21.15.105:0/1514979559 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:42.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.528+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/1514979559 >> v2:172.21.15.67:3300/0 conn(0x7fa5ec0c37e0 0x7fa5ec0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368356699 0 0) 0x7fa5ec14ff20 con 0x7fa5ec14fae0 2020-11-20T11:29:42.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003240 con 0x7fa5ec14fae0 2020-11-20T11:29:42.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853169172 0 0) 0x7fa5e4001450 con 0x7fa5ec1525c0 2020-11-20T11:29:42.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ec14ff20 con 0x7fa5ec1525c0 2020-11-20T11:29:42.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3067029282 0 0) 0x7fa5d8003240 con 0x7fa5ec14fae0 2020-11-20T11:29:42.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 >> v2:172.21.15.67:3300/0 conn(0x7fa5ec0c37e0 msgr2=0x7fa5ec0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 --2- 172.21.15.105:0/1514979559 >> v2:172.21.15.67:3300/0 conn(0x7fa5ec0c37e0 0x7fa5ec0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 >> v1:172.21.15.67:6789/0 conn(0x7fa5ec1525c0 legacy=0x7fa5ec0bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.540 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec153190 con 0x7fa5ec14fae0 2020-11-20T11:29:42.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fa5dc001520 con 0x7fa5ec14fae0 2020-11-20T11:29:42.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 >> v1:172.21.15.105:6789/0 conn(0x7fa5ec14fae0 legacy=0x7fa5ec0bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 0x7fa5d8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d80044e0 0x7fa5d8004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.541 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d8004e50 0x7fa5d800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec152ef0 con 0x7fa5d80044e0 2020-11-20T11:29:42.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d800bc20 con 0x7fa5d8004e50 2020-11-20T11:29:42.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d800bd60 con 0x7fa5d8003960 2020-11-20T11:29:42.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 0x7fa5d8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.542 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5ea7fc700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d80044e0 0x7fa5d8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eb7fe700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d8004e50 0x7fa5d800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 -- 172.21.15.105:0/1514979559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d8004e50 msgr2=0x7fa5d800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d8004e50 0x7fa5d800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 -- 172.21.15.105:0/1514979559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d80044e0 msgr2=0x7fa5d8004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.543 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d80044e0 0x7fa5d8004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 -- 172.21.15.105:0/1514979559 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8003240 con 0x7fa5d8003960 2020-11-20T11:29:42.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eb7fe700 1 -- 172.21.15.105:0/1514979559 reap_dead start 2020-11-20T11:29:42.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 0x7fa5d8003d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa5e000bc00 tx=0x7fa5e0006df0).ready entity=mon.2 client_cookie=a0f4605793f35215 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.544 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.529+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000b310 con 0x7fa5d8003960 2020-11-20T11:29:42.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000ea90 con 0x7fa5d8003960 2020-11-20T11:29:42.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5e9ffb700 1 -- 172.21.15.105:0/1514979559 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000ee10 con 0x7fa5d8003960 2020-11-20T11:29:42.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 -- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 msgr2=0x7fa5d8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.545 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 0x7fa5d8003d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa5e000bc00 tx=0x7fa5e0006df0).stop 2020-11-20T11:29:42.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 -- 172.21.15.105:0/1514979559 shutdown_connections 2020-11-20T11:29:42.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 --2- 172.21.15.105:0/1514979559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8003960 0x7fa5d8003d60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 -- 172.21.15.105:0/1514979559 >> 172.21.15.105:0/1514979559 conn(0x7fa5ec0b9910 msgr2=0x7fa5ec0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 -- 172.21.15.105:0/1514979559 shutdown_connections 2020-11-20T11:29:42.546 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.530+0000 7fa5f1794700 1 -- 172.21.15.105:0/1514979559 wait complete. 2020-11-20T11:29:42.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.531+0000 7fa5f1794700 1 Processor -- start 2020-11-20T11:29:42.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.531+0000 7fa5f1794700 1 -- start start 2020-11-20T11:29:42.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 0x7fa5ec09b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.547 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 0x7fa5ec0bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.548 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.549 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0bc400 con 0x7fa5d8003960 2020-11-20T11:29:42.549 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec160cb0 con 0x7fa5ec14c960 2020-11-20T11:29:42.549 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5f1794700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec160f50 con 0x7fa5ec14a150 2020-11-20T11:29:42.549 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41946/0 (socket says 172.21.15.105:41946) 2020-11-20T11:29:42.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 -- 172.21.15.105:0/403153566 learned_addr learned my addr 172.21.15.105:0/403153566 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:42.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5ea7fc700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 0x7fa5ec0bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 0x7fa5ec09b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 -- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 msgr2=0x7fa5ec0bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.551 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 0x7fa5ec0bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.551 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 -- 172.21.15.105:0/403153566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 msgr2=0x7fa5ec09b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.551 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 0x7fa5ec09b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.551 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eb7fe700 1 -- 172.21.15.105:0/403153566 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec1611f0 con 0x7fa5ec14a150 2020-11-20T11:29:42.551 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5ea7fc700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 0x7fa5ec0bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:42.552 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.532+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 0x7fa5ec09b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:42.552 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5eb7fe700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa5ec0bce20 tx=0x7fa5e4009040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.552 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4001a40 con 0x7fa5ec14a150 2020-11-20T11:29:42.552 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4001ba0 con 0x7fa5ec14a150 2020-11-20T11:29:42.552 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec161490 con 0x7fa5ec14a150 2020-11-20T11:29:42.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4006870 con 0x7fa5ec14a150 2020-11-20T11:29:42.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.533+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec0ba8b0 con 0x7fa5ec14a150 2020-11-20T11:29:42.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.534+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec161620 con 0x7fa5ec14a150 2020-11-20T11:29:42.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.534+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa5e401c060 con 0x7fa5ec14a150 2020-11-20T11:29:42.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.535+0000 7fa5d2ffd700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 0x7fa5c8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.535+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa5e40a2420 con 0x7fa5ec14a150 2020-11-20T11:29:42.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.535+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 0x7fa5c8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.535+0000 7fa5eaffd700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 0x7fa5c8082af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa5e0006e30 tx=0x7fa5e0019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.539+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa5e4076e30 con 0x7fa5ec14a150 2020-11-20T11:29:42.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.700+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fa5ec0bf560 con 0x7fa5ec14a150 2020-11-20T11:29:42.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.701+0000 7fa5d2ffd700 1 -- 172.21.15.105:0/403153566 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5ec0bf560 con 0x7fa5ec14a150 2020-11-20T11:29:42.705 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:42.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 msgr2=0x7fa5c8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 0x7fa5c8082af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa5e0006e30 tx=0x7fa5e0019000).stop 2020-11-20T11:29:42.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 msgr2=0x7fa5ec066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa5ec0bce20 tx=0x7fa5e4009040).stop 2020-11-20T11:29:42.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 shutdown_connections 2020-11-20T11:29:42.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa5c8080630 0x7fa5c8082af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5ec14a150 0x7fa5ec066790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5d8003960 0x7fa5ec09b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 --2- 172.21.15.105:0/403153566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5ec14c960 0x7fa5ec0bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 >> 172.21.15.105:0/403153566 conn(0x7fa5ec0b9910 msgr2=0x7fa5ec0b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 shutdown_connections 2020-11-20T11:29:42.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.702+0000 7fa5f1794700 1 -- 172.21.15.105:0/403153566 wait complete. 2020-11-20T11:29:42.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.8 2020-11-20T11:29:42.717 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T11:29:42.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.832+0000 7fcdd95bc700 1 Processor -- start 2020-11-20T11:29:42.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.832+0000 7fcdd95bc700 1 -- start start 2020-11-20T11:29:42.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd95bc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcdd4025c20 0x7fcdd4026000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd95bc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcdd40bbbe0 0x7fcdd4063d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd95bc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4152100 con 0x7fcdd41528a0 2020-11-20T11:29:42.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd95bc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40630a0 con 0x7fcdd40bbbe0 2020-11-20T11:29:42.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd95bc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd4063340 con 0x7fcdd4025c20 2020-11-20T11:29:42.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd37fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcdd41528a0 0x7fcdd414e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41556/0 (socket says 172.21.15.105:41556) 2020-11-20T11:29:42.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.833+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2452441114 learned_addr learned my addr 172.21.15.105:0/2452441114 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:42.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdcbfff700 1 --2- 172.21.15.105:0/2452441114 >> v2:172.21.15.67:3300/0 conn(0x7fcdd40bbbe0 0x7fcdd4063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd2ffd700 1 --2- 172.21.15.105:0/2452441114 >> v2:172.21.15.100:3300/0 conn(0x7fcdd4025c20 0x7fcdd4026000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143737086 0 0) 0x7fcdd4152100 con 0x7fcdd41528a0 2020-11-20T11:29:42.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb4003240 con 0x7fcdd41528a0 2020-11-20T11:29:42.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1109161486 0 0) 0x7fcdb4003240 con 0x7fcdd41528a0 2020-11-20T11:29:42.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 >> v2:172.21.15.100:3300/0 conn(0x7fcdd4025c20 msgr2=0x7fcdd4026000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 --2- 172.21.15.105:0/2452441114 >> v2:172.21.15.100:3300/0 conn(0x7fcdd4025c20 0x7fcdd4026000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 >> v2:172.21.15.67:3300/0 conn(0x7fcdd40bbbe0 msgr2=0x7fcdd4063d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 --2- 172.21.15.105:0/2452441114 >> v2:172.21.15.67:3300/0 conn(0x7fcdd40bbbe0 0x7fcdd4063d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40635e0 con 0x7fcdd41528a0 2020-11-20T11:29:42.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fcdcc001860 con 0x7fcdd41528a0 2020-11-20T11:29:42.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 >> v1:172.21.15.105:6789/0 conn(0x7fcdd41528a0 legacy=0x7fcdd414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4003780 0x7fcdb4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb40044e0 0x7fcdb4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 0x7fcdb400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40630a0 con 0x7fcdb4003780 2020-11-20T11:29:42.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4063340 con 0x7fcdb40044e0 2020-11-20T11:29:42.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4005300 con 0x7fcdb4004e50 2020-11-20T11:29:42.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 0x7fcdb400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdcbfff700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb40044e0 0x7fcdb4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd2ffd700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4003780 0x7fcdb4003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2452441114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb40044e0 msgr2=0x7fcdb4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb40044e0 0x7fcdb4004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2452441114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4003780 msgr2=0x7fcdb4003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4003780 0x7fcdb4003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2452441114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4003240 con 0x7fcdb4004e50 2020-11-20T11:29:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2452441114 reap_dead start 2020-11-20T11:29:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.834+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 0x7fcdb400b730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fcdcc00c870 tx=0x7fcdd4152290).ready entity=mon.2 client_cookie=ea483f19b1300c52 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc005b80 con 0x7fcdb4004e50 2020-11-20T11:29:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc005ce0 con 0x7fcdb4004e50 2020-11-20T11:29:42.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd27fc700 1 -- 172.21.15.105:0/2452441114 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc007300 con 0x7fcdb4004e50 2020-11-20T11:29:42.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 msgr2=0x7fcdb400b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 0x7fcdb400b730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fcdcc00c870 tx=0x7fcdd4152290).stop 2020-11-20T11:29:42.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2452441114 shutdown_connections 2020-11-20T11:29:42.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2452441114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb4004e50 0x7fcdb400b730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2452441114 >> 172.21.15.105:0/2452441114 conn(0x7fcdd40c4500 msgr2=0x7fcdd40c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:42.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2452441114 shutdown_connections 2020-11-20T11:29:42.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.835+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2452441114 wait complete. 2020-11-20T11:29:42.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.836+0000 7fcdd95bc700 1 Processor -- start 2020-11-20T11:29:42.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.836+0000 7fcdd95bc700 1 -- start start 2020-11-20T11:29:42.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4004e50 0x7fcdd4161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdd4161de0 0x7fcdd414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4164d90 con 0x7fcdb4004e50 2020-11-20T11:29:42.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4164850 con 0x7fcdd4161de0 2020-11-20T11:29:42.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd95bc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4164af0 con 0x7fcdd4163ee0 2020-11-20T11:29:42.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41968/0 (socket says 172.21.15.105:41968) 2020-11-20T11:29:42.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2642036677 learned_addr learned my addr 172.21.15.105:0/2642036677 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:42.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdcbfff700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdd4161de0 0x7fcdd414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd2ffd700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4004e50 0x7fcdd4161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdd4161de0 msgr2=0x7fcdd414f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdd4161de0 0x7fcdd414f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2642036677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4004e50 msgr2=0x7fcdd4161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:42.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4004e50 0x7fcdd4161400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:42.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 -- 172.21.15.105:0/2642036677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4160a20 con 0x7fcdd4163ee0 2020-11-20T11:29:42.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.837+0000 7fcdd37fe700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcdd40446d0 tx=0x7fcdcc013000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.838+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc01a040 con 0x7fcdd4163ee0 2020-11-20T11:29:42.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.838+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0076b0 con 0x7fcdd4163ee0 2020-11-20T11:29:42.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.838+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004880 con 0x7fcdd4163ee0 2020-11-20T11:29:42.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.838+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd4160cc0 con 0x7fcdd4163ee0 2020-11-20T11:29:42.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.838+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd4162260 con 0x7fcdd4163ee0 2020-11-20T11:29:42.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.840+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd40bc060 con 0x7fcdd4163ee0 2020-11-20T11:29:42.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.840+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcdcc010070 con 0x7fcdd4163ee0 2020-11-20T11:29:42.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.841+0000 7fcdcaffd700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 0x7fcdb0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:42.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.841+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcdcc0a3c30 con 0x7fcdd4163ee0 2020-11-20T11:29:42.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.841+0000 7fcdd2ffd700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 0x7fcdb0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:42.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.842+0000 7fcdd2ffd700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 0x7fcdb0082af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcdc4006d00 tx=0x7fcdc4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:42.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:42.844+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcdcc078640 con 0x7fcdd4163ee0 2020-11-20T11:29:43.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.005+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fcdd40bb3c0 con 0x7fcdd4163ee0 2020-11-20T11:29:43.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.006+0000 7fcdcaffd700 1 -- 172.21.15.105:0/2642036677 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcdcc07bc60 con 0x7fcdd4163ee0 2020-11-20T11:29:43.010 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 msgr2=0x7fcdb0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 0x7fcdb0082af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcdc4006d00 tx=0x7fcdc4008040).stop 2020-11-20T11:29:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 msgr2=0x7fcdd4149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcdd40446d0 tx=0x7fcdcc013000).stop 2020-11-20T11:29:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 shutdown_connections 2020-11-20T11:29:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fcdb0080630 0x7fcdb0082af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4163ee0 0x7fcdd4149f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb4004e50 0x7fcdd4161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 --2- 172.21.15.105:0/2642036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdd4161de0 0x7fcdd414f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 >> 172.21.15.105:0/2642036677 conn(0x7fcdd40c4500 msgr2=0x7fcdd414b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 shutdown_connections 2020-11-20T11:29:43.014 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.007+0000 7fcdd95bc700 1 -- 172.21.15.105:0/2642036677 wait complete. 2020-11-20T11:29:43.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.9 2020-11-20T11:29:43.022 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T11:29:43.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.137+0000 7f2146d69700 1 Processor -- start 2020-11-20T11:29:43.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.137+0000 7f2146d69700 1 -- start start 2020-11-20T11:29:43.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21400c37e0 0x7f21400c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f214014af60 0x7f214014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f21400bfdd0 0x7f21400c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214014e210 con 0x7f21400bfdd0 2020-11-20T11:29:43.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214014e4b0 con 0x7f214014af60 2020-11-20T11:29:43.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2146d69700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214014e750 con 0x7f21400c37e0 2020-11-20T11:29:43.144 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21400c37e0 0x7f21400c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21400c37e0 0x7f21400c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41972/0 (socket says 172.21.15.105:41972) 2020-11-20T11:29:43.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 -- 172.21.15.105:0/1535685256 learned_addr learned my addr 172.21.15.105:0/1535685256 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:43.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2145306700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.67:3300/0 conn(0x7f21400bfdd0 0x7f21400c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.145 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f213ffff700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.100:3300/0 conn(0x7f214014af60 0x7f214014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 -- 172.21.15.105:0/1535685256 >> v2:172.21.15.100:3300/0 conn(0x7f214014af60 msgr2=0x7f214014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:43.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.100:3300/0 conn(0x7f214014af60 0x7f214014b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 -- 172.21.15.105:0/1535685256 >> v2:172.21.15.67:3300/0 conn(0x7f21400bfdd0 msgr2=0x7f21400c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:43.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.67:3300/0 conn(0x7f21400bfdd0 0x7f21400c0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 -- 172.21.15.105:0/1535685256 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214014e9f0 con 0x7f21400c37e0 2020-11-20T11:29:43.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f2144b05700 1 --2- 172.21.15.105:0/1535685256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400c37e0 0x7f21400c3bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f21400ba450 tx=0x7f2128006eb0).ready entity=mon.2 client_cookie=eee10347b1bc5055 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f213f7fe700 1 -- 172.21.15.105:0/1535685256 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128009810 con 0x7f21400c37e0 2020-11-20T11:29:43.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f213f7fe700 1 -- 172.21.15.105:0/1535685256 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128009970 con 0x7f21400c37e0 2020-11-20T11:29:43.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.138+0000 7f213f7fe700 1 -- 172.21.15.105:0/1535685256 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128009cf0 con 0x7f21400c37e0 2020-11-20T11:29:43.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 -- 172.21.15.105:0/1535685256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400c37e0 msgr2=0x7f21400c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 --2- 172.21.15.105:0/1535685256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400c37e0 0x7f21400c3bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f21400ba450 tx=0x7f2128006eb0).stop 2020-11-20T11:29:43.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 -- 172.21.15.105:0/1535685256 shutdown_connections 2020-11-20T11:29:43.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.67:3300/0 conn(0x7f21400bfdd0 0x7f21400c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 --2- 172.21.15.105:0/1535685256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400c37e0 0x7f21400c3bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 --2- 172.21.15.105:0/1535685256 >> v2:172.21.15.100:3300/0 conn(0x7f214014af60 0x7f214014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 -- 172.21.15.105:0/1535685256 >> 172.21.15.105:0/1535685256 conn(0x7f21400b9910 msgr2=0x7f21400b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.155 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 -- 172.21.15.105:0/1535685256 shutdown_connections 2020-11-20T11:29:43.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.139+0000 7f2146d69700 1 -- 172.21.15.105:0/1535685256 wait complete. 2020-11-20T11:29:43.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.140+0000 7f2146d69700 1 Processor -- start 2020-11-20T11:29:43.156 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.140+0000 7f2146d69700 1 -- start start 2020-11-20T11:29:43.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 0x7f214014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f214014af60 0x7f2140138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21401412a0 con 0x7f214014af60 2020-11-20T11:29:43.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214014c980 con 0x7f21400c37e0 2020-11-20T11:29:43.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214013d040 con 0x7f21400bfdd0 2020-11-20T11:29:43.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41978/0 (socket says 172.21.15.105:41978) 2020-11-20T11:29:43.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 -- 172.21.15.105:0/2874156767 learned_addr learned my addr 172.21.15.105:0/2874156767 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:43.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2145306700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f214014af60 0x7f2140138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.162 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f213ffff700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 0x7f214014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 -- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 msgr2=0x7f214014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 0x7f214014c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 -- 172.21.15.105:0/2874156767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f214014af60 msgr2=0x7f2140138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.163 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f214014af60 0x7f2140138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 -- 172.21.15.105:0/2874156767 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140066b30 con 0x7f21400bfdd0 2020-11-20T11:29:43.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f213ffff700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 0x7f214014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:43.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2144b05700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f214014e890 tx=0x7f2128015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.164 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128011d50 con 0x7f21400bfdd0 2020-11-20T11:29:43.165 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212801e460 con 0x7f21400bfdd0 2020-11-20T11:29:43.165 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212801e7e0 con 0x7f21400bfdd0 2020-11-20T11:29:43.165 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214013d2a0 con 0x7f21400bfdd0 2020-11-20T11:29:43.165 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.141+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140141730 con 0x7f21400bfdd0 2020-11-20T11:29:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.142+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214015fad0 con 0x7f21400bfdd0 2020-11-20T11:29:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.143+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2128025030 con 0x7f21400bfdd0 2020-11-20T11:29:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.143+0000 7f213cff9700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 0x7f211c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.143+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f21280a40c0 con 0x7f21400bfdd0 2020-11-20T11:29:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.144+0000 7f213ffff700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 0x7f211c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.144+0000 7f213ffff700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 0x7f211c082af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f214009c200 tx=0x7f2130008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.147+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2128078ad0 con 0x7f21400bfdd0 2020-11-20T11:29:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.310+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f2140044f60 con 0x7f21400bfdd0 2020-11-20T11:29:43.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.310+0000 7f213cff9700 1 -- 172.21.15.105:0/2874156767 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f2128023030 con 0x7f21400bfdd0 2020-11-20T11:29:43.314 INFO:teuthology.orchestra.run.smithi105.stdout:73014444038 2020-11-20T11:29:43.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 msgr2=0x7f211c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 0x7f211c082af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f214009c200 tx=0x7f2130008040).stop 2020-11-20T11:29:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 msgr2=0x7f214009bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f214014e890 tx=0x7f2128015000).stop 2020-11-20T11:29:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 shutdown_connections 2020-11-20T11:29:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f214014af60 0x7f2140138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f211c080630 0x7f211c082af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400bfdd0 0x7f214009bd10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 --2- 172.21.15.105:0/2874156767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21400c37e0 0x7f214014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 >> 172.21.15.105:0/2874156767 conn(0x7f21400b9910 msgr2=0x7f21400bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 shutdown_connections 2020-11-20T11:29:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.312+0000 7f2146d69700 1 -- 172.21.15.105:0/2874156767 wait complete. 2020-11-20T11:29:43.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.10 2020-11-20T11:29:43.327 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T11:29:43.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.441+0000 7f72453cc700 1 Processor -- start 2020-11-20T11:29:43.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.442+0000 7f72453cc700 1 -- start start 2020-11-20T11:29:43.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.442+0000 7f72453cc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72400c37e0 0x7f72400c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.442+0000 7f72453cc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724014e210 con 0x7f724014af60 2020-11-20T11:29:43.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.442+0000 7f72453cc700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724014e4b0 con 0x7f72400bfdd0 2020-11-20T11:29:43.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.442+0000 7f72453cc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724014e750 con 0x7f72400c37e0 2020-11-20T11:29:43.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723e7fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f724014af60 0x7f724014b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:53052/0 (socket says 172.21.15.105:53052) 2020-11-20T11:29:43.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723e7fc700 1 -- 172.21.15.105:0/2446051490 learned_addr learned my addr 172.21.15.105:0/2446051490 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:43.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723effd700 1 --2- 172.21.15.105:0/2446051490 >> v2:172.21.15.100:3300/0 conn(0x7f72400c37e0 0x7f72400c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723dffb700 1 -- 172.21.15.105:0/2446051490 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984770282 0 0) 0x7f724014e210 con 0x7f724014af60 2020-11-20T11:29:43.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723dffb700 1 -- 172.21.15.105:0/2446051490 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f722c003240 con 0x7f724014af60 2020-11-20T11:29:43.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723effd700 1 -- 172.21.15.105:0/2446051490 >> v1:172.21.15.100:6789/0 conn(0x7f72400bfdd0 legacy=0x7f72400c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723effd700 1 -- 172.21.15.105:0/2446051490 >> v1:172.21.15.67:6789/0 conn(0x7f724014af60 legacy=0x7f724014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723effd700 1 -- 172.21.15.105:0/2446051490 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724014e9f0 con 0x7f72400c37e0 2020-11-20T11:29:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723effd700 1 --2- 172.21.15.105:0/2446051490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72400c37e0 0x7f72400c3bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7238009c90 tx=0x7f72380091d0).ready entity=mon.1 client_cookie=c1041a27e4951c64 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723dffb700 1 -- 172.21.15.105:0/2446051490 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800ba70 con 0x7f72400c37e0 2020-11-20T11:29:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723dffb700 1 -- 172.21.15.105:0/2446051490 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723800bbd0 con 0x7f72400c37e0 2020-11-20T11:29:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.443+0000 7f723dffb700 1 -- 172.21.15.105:0/2446051490 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238011400 con 0x7f72400c37e0 2020-11-20T11:29:43.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 -- 172.21.15.105:0/2446051490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72400c37e0 msgr2=0x7f72400c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 --2- 172.21.15.105:0/2446051490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72400c37e0 0x7f72400c3bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7238009c90 tx=0x7f72380091d0).stop 2020-11-20T11:29:43.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 -- 172.21.15.105:0/2446051490 shutdown_connections 2020-11-20T11:29:43.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 --2- 172.21.15.105:0/2446051490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72400c37e0 0x7f72400c3bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 -- 172.21.15.105:0/2446051490 >> 172.21.15.105:0/2446051490 conn(0x7f72400b9910 msgr2=0x7f72400b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 -- 172.21.15.105:0/2446051490 shutdown_connections 2020-11-20T11:29:43.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.444+0000 7f72453cc700 1 -- 172.21.15.105:0/2446051490 wait complete. 2020-11-20T11:29:43.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.445+0000 7f72453cc700 1 Processor -- start 2020-11-20T11:29:43.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.445+0000 7f72453cc700 1 -- start start 2020-11-20T11:29:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72400c37e0 0x7f7240146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f724014af60 0x7f72400c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72401514b0 con 0x7f72400c37e0 2020-11-20T11:29:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240151750 con 0x7f724014af60 2020-11-20T11:29:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f72453cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240160a70 con 0x7f72400bfdd0 2020-11-20T11:29:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41990/0 (socket says 172.21.15.105:41990) 2020-11-20T11:29:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 -- 172.21.15.105:0/4166709127 learned_addr learned my addr 172.21.15.105:0/4166709127 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723e7fc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72400c37e0 0x7f7240146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723f7fe700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f724014af60 0x7f72400c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 -- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f724014af60 msgr2=0x7f72400c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f724014af60 0x7f72400c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 -- 172.21.15.105:0/4166709127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72400c37e0 msgr2=0x7f7240146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72400c37e0 0x7f7240146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.446+0000 7f723effd700 1 -- 172.21.15.105:0/4166709127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240160d10 con 0x7f72400bfdd0 2020-11-20T11:29:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f723effd700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7238009210 tx=0x7f7238016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723801c5f0 con 0x7f72400bfdd0 2020-11-20T11:29:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723801c750 con 0x7f72400bfdd0 2020-11-20T11:29:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7240160fb0 con 0x7f72400bfdd0 2020-11-20T11:29:43.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723801cad0 con 0x7f72400bfdd0 2020-11-20T11:29:43.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.447+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72401616f0 con 0x7f72400bfdd0 2020-11-20T11:29:43.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.448+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7240161410 con 0x7f72400bfdd0 2020-11-20T11:29:43.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.448+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7238024030 con 0x7f72400bfdd0 2020-11-20T11:29:43.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.449+0000 7f7226ffd700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 0x7f721c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.449+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f72380a4570 con 0x7f72400bfdd0 2020-11-20T11:29:43.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.449+0000 7f723e7fc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 0x7f721c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.449+0000 7f723e7fc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 0x7f721c082b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f72400c0a90 tx=0x7f7234009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.452+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7238078f80 con 0x7f72400bfdd0 2020-11-20T11:29:43.617 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.614+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f7240044f60 con 0x7f72400bfdd0 2020-11-20T11:29:43.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.614+0000 7f7226ffd700 1 -- 172.21.15.105:0/4166709127 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f7238022030 con 0x7f72400bfdd0 2020-11-20T11:29:43.618 INFO:teuthology.orchestra.run.smithi105.stdout:73014444039 2020-11-20T11:29:43.619 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 msgr2=0x7f721c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 0x7f721c082b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f72400c0a90 tx=0x7f7234009040).stop 2020-11-20T11:29:43.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 msgr2=0x7f7240150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7238009210 tx=0x7f7238016000).stop 2020-11-20T11:29:43.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 shutdown_connections 2020-11-20T11:29:43.620 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f724014af60 0x7f72400c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f721c080660 0x7f721c082b20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72400bfdd0 0x7f7240150f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 --2- 172.21.15.105:0/4166709127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72400c37e0 0x7f7240146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 >> 172.21.15.105:0/4166709127 conn(0x7f72400b9910 msgr2=0x7f724014d740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 shutdown_connections 2020-11-20T11:29:43.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.616+0000 7f72453cc700 1 -- 172.21.15.105:0/4166709127 wait complete. 2020-11-20T11:29:43.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.11 2020-11-20T11:29:43.631 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T11:29:43.631 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:29:43.753 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.750+0000 7fc376f56700 1 Processor -- start 2020-11-20T11:29:43.754 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.750+0000 7fc376f56700 1 -- start start 2020-11-20T11:29:43.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc376f56700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc37014b390 0x7fc37014df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc376f56700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc37014b770 0x7fc3700c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc376f56700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3700bfc10 con 0x7fc3700c0aa0 2020-11-20T11:29:43.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc376f56700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37014eec0 con 0x7fc37014b770 2020-11-20T11:29:43.757 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc376f56700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37014e6e0 con 0x7fc37014b390 2020-11-20T11:29:43.757 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc37014b390 0x7fc37014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.757 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc3754f3700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc3700c0aa0 0x7fc370062780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41606/0 (socket says 172.21.15.105:41606) 2020-11-20T11:29:43.758 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc3754f3700 1 -- 172.21.15.105:0/3232225443 learned_addr learned my addr 172.21.15.105:0/3232225443 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:43.758 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 --2- 172.21.15.105:0/3232225443 >> v2:172.21.15.105:3300/0 conn(0x7fc37014b390 0x7fc37014df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41998/0 (socket says 172.21.15.105:41998) 2020-11-20T11:29:43.758 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc36ffff700 1 --2- 172.21.15.105:0/3232225443 >> v2:172.21.15.67:3300/0 conn(0x7fc37014b770 0x7fc3700c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.758 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 -- 172.21.15.105:0/3232225443 >> v2:172.21.15.67:3300/0 conn(0x7fc37014b770 msgr2=0x7fc3700c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:43.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 --2- 172.21.15.105:0/3232225443 >> v2:172.21.15.67:3300/0 conn(0x7fc37014b770 0x7fc3700c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 -- 172.21.15.105:0/3232225443 >> v1:172.21.15.105:6789/0 conn(0x7fc3700c0aa0 legacy=0x7fc370062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc36f7fe700 1 -- 172.21.15.105:0/3232225443 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138203570 0 0) 0x7fc3700bfc10 con 0x7fc3700c0aa0 2020-11-20T11:29:43.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 -- 172.21.15.105:0/3232225443 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37014e980 con 0x7fc37014b390 2020-11-20T11:29:43.759 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc374cf2700 1 --2- 172.21.15.105:0/3232225443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b390 0x7fc37014df20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc3700c36a0 tx=0x7fc358006df0).ready entity=mon.2 client_cookie=2342a9c14e237c41 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.760 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc36f7fe700 1 -- 172.21.15.105:0/3232225443 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580097b0 con 0x7fc37014b390 2020-11-20T11:29:43.760 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc36f7fe700 1 -- 172.21.15.105:0/3232225443 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358009910 con 0x7fc37014b390 2020-11-20T11:29:43.760 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.751+0000 7fc36f7fe700 1 -- 172.21.15.105:0/3232225443 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358009c90 con 0x7fc37014b390 2020-11-20T11:29:43.760 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 -- 172.21.15.105:0/3232225443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b390 msgr2=0x7fc37014df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.760 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 --2- 172.21.15.105:0/3232225443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b390 0x7fc37014df20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc3700c36a0 tx=0x7fc358006df0).stop 2020-11-20T11:29:43.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 -- 172.21.15.105:0/3232225443 shutdown_connections 2020-11-20T11:29:43.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 --2- 172.21.15.105:0/3232225443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b390 0x7fc37014df20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 --2- 172.21.15.105:0/3232225443 >> v2:172.21.15.67:3300/0 conn(0x7fc37014b770 0x7fc3700c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 -- 172.21.15.105:0/3232225443 >> 172.21.15.105:0/3232225443 conn(0x7fc3700b9910 msgr2=0x7fc3700b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 -- 172.21.15.105:0/3232225443 shutdown_connections 2020-11-20T11:29:43.762 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.752+0000 7fc376f56700 1 -- 172.21.15.105:0/3232225443 wait complete. 2020-11-20T11:29:43.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.753+0000 7fc376f56700 1 Processor -- start 2020-11-20T11:29:43.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.753+0000 7fc376f56700 1 -- start start 2020-11-20T11:29:43.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3700c0aa0 0x7fc37014c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc37014b390 0x7fc3700bc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37014cc10 con 0x7fc37014b390 2020-11-20T11:29:43.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701473d0 con 0x7fc3700c0aa0 2020-11-20T11:29:43.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37014c970 con 0x7fc37014b770 2020-11-20T11:29:43.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42006/0 (socket says 172.21.15.105:42006) 2020-11-20T11:29:43.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 -- 172.21.15.105:0/4123376934 learned_addr learned my addr 172.21.15.105:0/4123376934 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:43.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc36ffff700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc37014b390 0x7fc3700bc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc374cf2700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3700c0aa0 0x7fc37014c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 -- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3700c0aa0 msgr2=0x7fc37014c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.767 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3700c0aa0 0x7fc37014c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 -- 172.21.15.105:0/4123376934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc37014b390 msgr2=0x7fc3700bc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc37014b390 0x7fc3700bc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 -- 172.21.15.105:0/4123376934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370146750 con 0x7fc37014b770 2020-11-20T11:29:43.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc3754f3700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc36800cae0 tx=0x7fc368007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368005b80 con 0x7fc37014b770 2020-11-20T11:29:43.769 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368005ce0 con 0x7fc37014b770 2020-11-20T11:29:43.769 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3701469f0 con 0x7fc37014b770 2020-11-20T11:29:43.769 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368007320 con 0x7fc37014b770 2020-11-20T11:29:43.769 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.754+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc370146f30 con 0x7fc37014b770 2020-11-20T11:29:43.769 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.755+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc370044f60 con 0x7fc37014b770 2020-11-20T11:29:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.756+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc368010030 con 0x7fc37014b770 2020-11-20T11:29:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.756+0000 7fc36cff9700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 0x7fc34c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.757+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc3680a2b40 con 0x7fc37014b770 2020-11-20T11:29:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.757+0000 7fc374cf2700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 0x7fc34c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.757+0000 7fc374cf2700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 0x7fc34c082af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc358006e30 tx=0x7fc358015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.760+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc368077550 con 0x7fc37014b770 2020-11-20T11:29:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.922+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc370147130 con 0x7fc34c080630 2020-11-20T11:29:43.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.927+0000 7fc36cff9700 1 -- 172.21.15.105:0/4123376934 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100700 (secure 0 0 0) 0x7fc358000b80 con 0x7fc34c080630 2020-11-20T11:29:43.930 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:43.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 msgr2=0x7fc34c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 0x7fc34c082af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc358006e30 tx=0x7fc358015000).stop 2020-11-20T11:29:43.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 msgr2=0x7fc37014d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:43.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc36800cae0 tx=0x7fc368007d40).stop 2020-11-20T11:29:43.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 shutdown_connections 2020-11-20T11:29:43.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc34c080630 0x7fc34c082af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc37014b770 0x7fc37014d310 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3700c0aa0 0x7fc37014c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 --2- 172.21.15.105:0/4123376934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc37014b390 0x7fc3700bc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:43.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 >> 172.21.15.105:0/4123376934 conn(0x7fc3700b9910 msgr2=0x7fc370148280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:43.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 shutdown_connections 2020-11-20T11:29:43.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:43.928+0000 7fc376f56700 1 -- 172.21.15.105:0/4123376934 wait complete. 2020-11-20T11:29:43.939 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:29:43.943 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-11-20T11:29:43.199713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61856,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58240,"kb_avail":1132400224,"statfs":{"total":1159641169920,"available":1159577829376,"internally_reserved":0,"allocated":3604480,"data_stored":1641156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59637760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.033030"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811544+0000","last_change":"2020-11-20T11:29:31.810475+0000","last_active":"2020-11-20T11:29:31.811544+0000","last_peered":"2020-11-20T11:29:31.811544+0000","last_clean":"2020-11-20T11:29:31.811544+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:29:31.811544+0000","last_undegraded":"2020-11-20T11:29:31.811544+0000","last_fullsized":"2020-11-20T11:29:31.811544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808195+0000","last_change":"2020-11-20T11:29:25.767208+0000","last_active":"2020-11-20T11:29:31.808195+0000","last_peered":"2020-11-20T11:29:31.808195+0000","last_clean":"2020-11-20T11:29:31.808195+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:29:31.808195+0000","last_undegraded":"2020-11-20T11:29:31.808195+0000","last_fullsized":"2020-11-20T11:29:31.808195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.179817+0000","last_change":"2020-11-20T11:29:28.782434+0000","last_active":"2020-11-20T11:29:32.179817+0000","last_peered":"2020-11-20T11:29:32.179817+0000","last_clean":"2020-11-20T11:29:32.179817+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:29:32.179817+0000","last_undegraded":"2020-11-20T11:29:32.179817+0000","last_fullsized":"2020-11-20T11:29:32.179817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.800035+0000","last_change":"2020-11-20T11:29:31.798351+0000","last_active":"2020-11-20T11:29:31.800035+0000","last_peered":"2020-11-20T11:29:31.800035+0000","last_clean":"2020-11-20T11:29:31.800035+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:29:31.800035+0000","last_undegraded":"2020-11-20T11:29:31.800035+0000","last_fullsized":"2020-11-20T11:29:31.800035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765743+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.175727+0000","last_change":"2020-11-20T11:29:28.783632+0000","last_active":"2020-11-20T11:29:32.175727+0000","last_peered":"2020-11-20T11:29:32.175727+0000","last_clean":"2020-11-20T11:29:32.175727+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:29:32.175727+0000","last_undegraded":"2020-11-20T11:29:32.175727+0000","last_fullsized":"2020-11-20T11:29:32.175727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.801699+0000","last_change":"2020-11-20T11:29:31.800906+0000","last_active":"2020-11-20T11:29:31.801699+0000","last_peered":"2020-11-20T11:29:31.801699+0000","last_clean":"2020-11-20T11:29:31.801699+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:29:31.801699+0000","last_undegraded":"2020-11-20T11:29:31.801699+0000","last_fullsized":"2020-11-20T11:29:31.801699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.791132+0000","last_change":"2020-11-20T11:29:25.767097+0000","last_active":"2020-11-20T11:29:31.791132+0000","last_peered":"2020-11-20T11:29:31.791132+0000","last_clean":"2020-11-20T11:29:31.791132+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:29:31.791132+0000","last_undegraded":"2020-11-20T11:29:31.791132+0000","last_fullsized":"2020-11-20T11:29:31.791132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.182407+0000","last_change":"2020-11-20T11:29:28.835642+0000","last_active":"2020-11-20T11:29:32.182407+0000","last_peered":"2020-11-20T11:29:32.182407+0000","last_clean":"2020-11-20T11:29:32.182407+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:29:32.182407+0000","last_undegraded":"2020-11-20T11:29:32.182407+0000","last_fullsized":"2020-11-20T11:29:32.182407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.813473+0000","last_change":"2020-11-20T11:29:31.810409+0000","last_active":"2020-11-20T11:29:31.813473+0000","last_peered":"2020-11-20T11:29:31.813473+0000","last_clean":"2020-11-20T11:29:31.813473+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:29:31.813473+0000","last_undegraded":"2020-11-20T11:29:31.813473+0000","last_fullsized":"2020-11-20T11:29:31.813473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806853+0000","last_change":"2020-11-20T11:29:25.810118+0000","last_active":"2020-11-20T11:29:31.806853+0000","last_peered":"2020-11-20T11:29:31.806853+0000","last_clean":"2020-11-20T11:29:31.806853+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:29:31.806853+0000","last_undegraded":"2020-11-20T11:29:31.806853+0000","last_fullsized":"2020-11-20T11:29:31.806853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793781+0000","last_change":"2020-11-20T11:29:17.224872+0000","last_active":"2020-11-20T11:29:31.793781+0000","last_peered":"2020-11-20T11:29:31.793781+0000","last_clean":"2020-11-20T11:29:31.793781+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:29:31.793781+0000","last_undegraded":"2020-11-20T11:29:31.793781+0000","last_fullsized":"2020-11-20T11:29:31.793781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_clean_scrub_stamp":"2020-11-20T11:29:11.234877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.176125+0000","last_change":"2020-11-20T11:29:28.947687+0000","last_active":"2020-11-20T11:29:32.176125+0000","last_peered":"2020-11-20T11:29:32.176125+0000","last_clean":"2020-11-20T11:29:32.176125+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:29:32.176125+0000","last_undegraded":"2020-11-20T11:29:32.176125+0000","last_fullsized":"2020-11-20T11:29:32.176125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.799518+0000","last_change":"2020-11-20T11:29:31.796907+0000","last_active":"2020-11-20T11:29:31.799518+0000","last_peered":"2020-11-20T11:29:31.799518+0000","last_clean":"2020-11-20T11:29:31.799518+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:29:31.799518+0000","last_undegraded":"2020-11-20T11:29:31.799518+0000","last_fullsized":"2020-11-20T11:29:31.799518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765835+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808109+0000","last_change":"2020-11-20T11:29:28.783019+0000","last_active":"2020-11-20T11:29:31.808109+0000","last_peered":"2020-11-20T11:29:31.808109+0000","last_clean":"2020-11-20T11:29:31.808109+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:29:31.808109+0000","last_undegraded":"2020-11-20T11:29:31.808109+0000","last_fullsized":"2020-11-20T11:29:31.808109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811804+0000","last_change":"2020-11-20T11:29:31.810862+0000","last_active":"2020-11-20T11:29:31.811804+0000","last_peered":"2020-11-20T11:29:31.811804+0000","last_clean":"2020-11-20T11:29:31.811804+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:29:31.811804+0000","last_undegraded":"2020-11-20T11:29:31.811804+0000","last_fullsized":"2020-11-20T11:29:31.811804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793228+0000","last_change":"2020-11-20T11:29:25.765870+0000","last_active":"2020-11-20T11:29:31.793228+0000","last_peered":"2020-11-20T11:29:31.793228+0000","last_clean":"2020-11-20T11:29:31.793228+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:29:31.793228+0000","last_undegraded":"2020-11-20T11:29:31.793228+0000","last_fullsized":"2020-11-20T11:29:31.793228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.184854+0000","last_change":"2020-11-20T11:29:28.781951+0000","last_active":"2020-11-20T11:29:32.184854+0000","last_peered":"2020-11-20T11:29:32.184854+0000","last_clean":"2020-11-20T11:29:32.184854+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:29:32.184854+0000","last_undegraded":"2020-11-20T11:29:32.184854+0000","last_fullsized":"2020-11-20T11:29:32.184854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811420+0000","last_change":"2020-11-20T11:29:31.810620+0000","last_active":"2020-11-20T11:29:31.811420+0000","last_peered":"2020-11-20T11:29:31.811420+0000","last_clean":"2020-11-20T11:29:31.811420+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:29:31.811420+0000","last_undegraded":"2020-11-20T11:29:31.811420+0000","last_fullsized":"2020-11-20T11:29:31.811420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.178287+0000","last_change":"2020-11-20T11:29:28.835613+0000","last_active":"2020-11-20T11:29:32.178287+0000","last_peered":"2020-11-20T11:29:32.178287+0000","last_clean":"2020-11-20T11:29:32.178287+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:29:32.178287+0000","last_undegraded":"2020-11-20T11:29:32.178287+0000","last_fullsized":"2020-11-20T11:29:32.178287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.788241+0000","last_change":"2020-11-20T11:29:26.041682+0000","last_active":"2020-11-20T11:29:31.788241+0000","last_peered":"2020-11-20T11:29:31.788241+0000","last_clean":"2020-11-20T11:29:31.788241+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:29:31.788241+0000","last_undegraded":"2020-11-20T11:29:31.788241+0000","last_fullsized":"2020-11-20T11:29:31.788241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.843486+0000","last_change":"2020-11-20T11:29:31.843080+0000","last_active":"2020-11-20T11:29:31.843486+0000","last_peered":"2020-11-20T11:29:31.843486+0000","last_clean":"2020-11-20T11:29:31.843486+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:29:31.843486+0000","last_undegraded":"2020-11-20T11:29:31.843486+0000","last_fullsized":"2020-11-20T11:29:31.843486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793857+0000","last_change":"2020-11-20T11:29:25.765016+0000","last_active":"2020-11-20T11:29:31.793857+0000","last_peered":"2020-11-20T11:29:31.793857+0000","last_clean":"2020-11-20T11:29:31.793857+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:29:31.793857+0000","last_undegraded":"2020-11-20T11:29:31.793857+0000","last_fullsized":"2020-11-20T11:29:31.793857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.177678+0000","last_change":"2020-11-20T11:29:28.780167+0000","last_active":"2020-11-20T11:29:32.177678+0000","last_peered":"2020-11-20T11:29:32.177678+0000","last_clean":"2020-11-20T11:29:32.177678+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:29:32.177678+0000","last_undegraded":"2020-11-20T11:29:32.177678+0000","last_fullsized":"2020-11-20T11:29:32.177678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.887}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.917}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.04}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":138074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.804}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8320000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":1,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":299008,"data_stored":136413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0219999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9259999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1379999999999999}]}]}]}} 2020-11-20T11:29:43.947 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:29:44.075 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.062+0000 7f82e34e7700 1 Processor -- start 2020-11-20T11:29:44.076 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.062+0000 7f82e34e7700 1 -- start start 2020-11-20T11:29:44.076 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e34e7700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82dc14b390 0x7f82dc14df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.076 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e34e7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82dc14b770 0x7f82dc0c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.077 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e34e7700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc0bfc10 con 0x7f82dc0c0aa0 2020-11-20T11:29:44.077 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e34e7700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc14eec0 con 0x7f82dc14b770 2020-11-20T11:29:44.078 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e34e7700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc14e6e0 con 0x7f82dc14b390 2020-11-20T11:29:44.078 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82dc14b390 0x7f82dc14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.078 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1a84700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f82dc0c0aa0 0x7f82dc062780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41620/0 (socket says 172.21.15.105:41620) 2020-11-20T11:29:44.079 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1a84700 1 -- 172.21.15.105:0/1507145688 learned_addr learned my addr 172.21.15.105:0/1507145688 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:44.079 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e0a82700 1 --2- 172.21.15.105:0/1507145688 >> v2:172.21.15.100:3300/0 conn(0x7f82dc14b770 0x7f82dc0c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.080 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 -- 172.21.15.105:0/1507145688 >> v2:172.21.15.100:3300/0 conn(0x7f82dc14b770 msgr2=0x7f82dc0c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:44.080 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 --2- 172.21.15.105:0/1507145688 >> v2:172.21.15.100:3300/0 conn(0x7f82dc14b770 0x7f82dc0c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.080 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 -- 172.21.15.105:0/1507145688 >> v1:172.21.15.105:6789/0 conn(0x7f82dc0c0aa0 legacy=0x7f82dc062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.081 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82cbfff700 1 -- 172.21.15.105:0/1507145688 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007819802 0 0) 0x7f82dc0bfc10 con 0x7f82dc0c0aa0 2020-11-20T11:29:44.081 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 -- 172.21.15.105:0/1507145688 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc14e980 con 0x7f82dc14b390 2020-11-20T11:29:44.082 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82e1283700 1 --2- 172.21.15.105:0/1507145688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc14df20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f82dc0c36a0 tx=0x7f82cc006df0).ready entity=mon.2 client_cookie=a56b26282582366e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.082 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82cbfff700 1 -- 172.21.15.105:0/1507145688 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0097b0 con 0x7f82dc14b390 2020-11-20T11:29:44.082 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82cbfff700 1 -- 172.21.15.105:0/1507145688 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc009910 con 0x7f82dc14b390 2020-11-20T11:29:44.083 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.063+0000 7f82cbfff700 1 -- 172.21.15.105:0/1507145688 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc009c90 con 0x7f82dc14b390 2020-11-20T11:29:44.083 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 -- 172.21.15.105:0/1507145688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 msgr2=0x7f82dc14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.084 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1507145688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc14df20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f82dc0c36a0 tx=0x7f82cc006df0).stop 2020-11-20T11:29:44.084 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 -- 172.21.15.105:0/1507145688 shutdown_connections 2020-11-20T11:29:44.084 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1507145688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc14df20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.085 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1507145688 >> v2:172.21.15.100:3300/0 conn(0x7f82dc14b770 0x7f82dc0c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.085 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 -- 172.21.15.105:0/1507145688 >> 172.21.15.105:0/1507145688 conn(0x7f82dc0b9910 msgr2=0x7f82dc0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 -- 172.21.15.105:0/1507145688 shutdown_connections 2020-11-20T11:29:44.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.064+0000 7f82e34e7700 1 -- 172.21.15.105:0/1507145688 wait complete. 2020-11-20T11:29:44.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.065+0000 7f82e34e7700 1 Processor -- start 2020-11-20T11:29:44.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.065+0000 7f82e34e7700 1 -- start start 2020-11-20T11:29:44.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 0x7f82dc151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82dc14b770 0x7f82dc065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc15e250 con 0x7f82dc0c0aa0 2020-11-20T11:29:44.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc14a2c0 con 0x7f82dc14b770 2020-11-20T11:29:44.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e34e7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc14a560 con 0x7f82dc14b390 2020-11-20T11:29:44.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42022/0 (socket says 172.21.15.105:42022) 2020-11-20T11:29:44.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 -- 172.21.15.105:0/1379678983 learned_addr learned my addr 172.21.15.105:0/1379678983 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:44.091 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e1a84700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82dc14b770 0x7f82dc065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.091 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e1283700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 0x7f82dc151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.091 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 -- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82dc14b770 msgr2=0x7f82dc065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.092 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82dc14b770 0x7f82dc065160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.092 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 -- 172.21.15.105:0/1379678983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 msgr2=0x7f82dc151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 0x7f82dc151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 -- 172.21.15.105:0/1379678983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc14a800 con 0x7f82dc14b390 2020-11-20T11:29:44.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e1283700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 0x7f82dc151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:44.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.066+0000 7f82e0a82700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f82d800d8e0 tx=0x7f82d8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.067+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8009650 con 0x7f82dc14b390 2020-11-20T11:29:44.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.067+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d80097b0 con 0x7f82dc14b390 2020-11-20T11:29:44.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.067+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc14aaa0 con 0x7f82dc14b390 2020-11-20T11:29:44.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.067+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8009b50 con 0x7f82dc14b390 2020-11-20T11:29:44.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.067+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc149f80 con 0x7f82dc14b390 2020-11-20T11:29:44.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.068+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc044f60 con 0x7f82dc14b390 2020-11-20T11:29:44.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.068+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f82d8013480 con 0x7f82dc14b390 2020-11-20T11:29:44.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.069+0000 7f82c97fa700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 0x7f82b8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.069+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f82d80a2d30 con 0x7f82dc14b390 2020-11-20T11:29:44.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.069+0000 7f82e1283700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 0x7f82b8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.069+0000 7f82e1283700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 0x7f82b8082af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f82cc00c010 tx=0x7f82cc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.100 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.072+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f82d80a7070 con 0x7f82dc14b390 2020-11-20T11:29:44.232 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.228+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82dc149d60 con 0x7f82b8080630 2020-11-20T11:29:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.233+0000 7f82c97fa700 1 -- 172.21.15.105:0/1379678983 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100700 (secure 0 0 0) 0x7f82dc149d60 con 0x7f82b8080630 2020-11-20T11:29:44.237 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:44.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.234+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 msgr2=0x7f82b8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.234+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 0x7f82b8082af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f82cc00c010 tx=0x7f82cc015000).stop 2020-11-20T11:29:44.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.234+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 msgr2=0x7f82dc15e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.234+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f82d800d8e0 tx=0x7f82d8008040).stop 2020-11-20T11:29:44.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 shutdown_connections 2020-11-20T11:29:44.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82dc14b770 0x7f82dc065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82dc0c0aa0 0x7f82dc151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f82b8080630 0x7f82b8082af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 --2- 172.21.15.105:0/1379678983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82dc14b390 0x7f82dc15e970 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 >> 172.21.15.105:0/1379678983 conn(0x7f82dc0b9910 msgr2=0x7f82dc146960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 shutdown_connections 2020-11-20T11:29:44.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.235+0000 7f82e34e7700 1 -- 172.21.15.105:0/1379678983 wait complete. 2020-11-20T11:29:44.247 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:29:44.249 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-11-20T11:29:43.199713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61856,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58240,"kb_avail":1132400224,"statfs":{"total":1159641169920,"available":1159577829376,"internally_reserved":0,"allocated":3604480,"data_stored":1641156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59637760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.033030"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811544+0000","last_change":"2020-11-20T11:29:31.810475+0000","last_active":"2020-11-20T11:29:31.811544+0000","last_peered":"2020-11-20T11:29:31.811544+0000","last_clean":"2020-11-20T11:29:31.811544+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:29:31.811544+0000","last_undegraded":"2020-11-20T11:29:31.811544+0000","last_fullsized":"2020-11-20T11:29:31.811544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808195+0000","last_change":"2020-11-20T11:29:25.767208+0000","last_active":"2020-11-20T11:29:31.808195+0000","last_peered":"2020-11-20T11:29:31.808195+0000","last_clean":"2020-11-20T11:29:31.808195+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:29:31.808195+0000","last_undegraded":"2020-11-20T11:29:31.808195+0000","last_fullsized":"2020-11-20T11:29:31.808195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.179817+0000","last_change":"2020-11-20T11:29:28.782434+0000","last_active":"2020-11-20T11:29:32.179817+0000","last_peered":"2020-11-20T11:29:32.179817+0000","last_clean":"2020-11-20T11:29:32.179817+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:29:32.179817+0000","last_undegraded":"2020-11-20T11:29:32.179817+0000","last_fullsized":"2020-11-20T11:29:32.179817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.800035+0000","last_change":"2020-11-20T11:29:31.798351+0000","last_active":"2020-11-20T11:29:31.800035+0000","last_peered":"2020-11-20T11:29:31.800035+0000","last_clean":"2020-11-20T11:29:31.800035+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:29:31.800035+0000","last_undegraded":"2020-11-20T11:29:31.800035+0000","last_fullsized":"2020-11-20T11:29:31.800035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765743+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.175727+0000","last_change":"2020-11-20T11:29:28.783632+0000","last_active":"2020-11-20T11:29:32.175727+0000","last_peered":"2020-11-20T11:29:32.175727+0000","last_clean":"2020-11-20T11:29:32.175727+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:29:32.175727+0000","last_undegraded":"2020-11-20T11:29:32.175727+0000","last_fullsized":"2020-11-20T11:29:32.175727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.801699+0000","last_change":"2020-11-20T11:29:31.800906+0000","last_active":"2020-11-20T11:29:31.801699+0000","last_peered":"2020-11-20T11:29:31.801699+0000","last_clean":"2020-11-20T11:29:31.801699+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:29:31.801699+0000","last_undegraded":"2020-11-20T11:29:31.801699+0000","last_fullsized":"2020-11-20T11:29:31.801699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.791132+0000","last_change":"2020-11-20T11:29:25.767097+0000","last_active":"2020-11-20T11:29:31.791132+0000","last_peered":"2020-11-20T11:29:31.791132+0000","last_clean":"2020-11-20T11:29:31.791132+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:29:31.791132+0000","last_undegraded":"2020-11-20T11:29:31.791132+0000","last_fullsized":"2020-11-20T11:29:31.791132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.182407+0000","last_change":"2020-11-20T11:29:28.835642+0000","last_active":"2020-11-20T11:29:32.182407+0000","last_peered":"2020-11-20T11:29:32.182407+0000","last_clean":"2020-11-20T11:29:32.182407+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:29:32.182407+0000","last_undegraded":"2020-11-20T11:29:32.182407+0000","last_fullsized":"2020-11-20T11:29:32.182407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.813473+0000","last_change":"2020-11-20T11:29:31.810409+0000","last_active":"2020-11-20T11:29:31.813473+0000","last_peered":"2020-11-20T11:29:31.813473+0000","last_clean":"2020-11-20T11:29:31.813473+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:29:31.813473+0000","last_undegraded":"2020-11-20T11:29:31.813473+0000","last_fullsized":"2020-11-20T11:29:31.813473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806853+0000","last_change":"2020-11-20T11:29:25.810118+0000","last_active":"2020-11-20T11:29:31.806853+0000","last_peered":"2020-11-20T11:29:31.806853+0000","last_clean":"2020-11-20T11:29:31.806853+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:29:31.806853+0000","last_undegraded":"2020-11-20T11:29:31.806853+0000","last_fullsized":"2020-11-20T11:29:31.806853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793781+0000","last_change":"2020-11-20T11:29:17.224872+0000","last_active":"2020-11-20T11:29:31.793781+0000","last_peered":"2020-11-20T11:29:31.793781+0000","last_clean":"2020-11-20T11:29:31.793781+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:29:31.793781+0000","last_undegraded":"2020-11-20T11:29:31.793781+0000","last_fullsized":"2020-11-20T11:29:31.793781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_clean_scrub_stamp":"2020-11-20T11:29:11.234877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.176125+0000","last_change":"2020-11-20T11:29:28.947687+0000","last_active":"2020-11-20T11:29:32.176125+0000","last_peered":"2020-11-20T11:29:32.176125+0000","last_clean":"2020-11-20T11:29:32.176125+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:29:32.176125+0000","last_undegraded":"2020-11-20T11:29:32.176125+0000","last_fullsized":"2020-11-20T11:29:32.176125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.799518+0000","last_change":"2020-11-20T11:29:31.796907+0000","last_active":"2020-11-20T11:29:31.799518+0000","last_peered":"2020-11-20T11:29:31.799518+0000","last_clean":"2020-11-20T11:29:31.799518+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:29:31.799518+0000","last_undegraded":"2020-11-20T11:29:31.799518+0000","last_fullsized":"2020-11-20T11:29:31.799518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765835+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808109+0000","last_change":"2020-11-20T11:29:28.783019+0000","last_active":"2020-11-20T11:29:31.808109+0000","last_peered":"2020-11-20T11:29:31.808109+0000","last_clean":"2020-11-20T11:29:31.808109+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:29:31.808109+0000","last_undegraded":"2020-11-20T11:29:31.808109+0000","last_fullsized":"2020-11-20T11:29:31.808109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811804+0000","last_change":"2020-11-20T11:29:31.810862+0000","last_active":"2020-11-20T11:29:31.811804+0000","last_peered":"2020-11-20T11:29:31.811804+0000","last_clean":"2020-11-20T11:29:31.811804+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:29:31.811804+0000","last_undegraded":"2020-11-20T11:29:31.811804+0000","last_fullsized":"2020-11-20T11:29:31.811804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793228+0000","last_change":"2020-11-20T11:29:25.765870+0000","last_active":"2020-11-20T11:29:31.793228+0000","last_peered":"2020-11-20T11:29:31.793228+0000","last_clean":"2020-11-20T11:29:31.793228+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:29:31.793228+0000","last_undegraded":"2020-11-20T11:29:31.793228+0000","last_fullsized":"2020-11-20T11:29:31.793228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.184854+0000","last_change":"2020-11-20T11:29:28.781951+0000","last_active":"2020-11-20T11:29:32.184854+0000","last_peered":"2020-11-20T11:29:32.184854+0000","last_clean":"2020-11-20T11:29:32.184854+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:29:32.184854+0000","last_undegraded":"2020-11-20T11:29:32.184854+0000","last_fullsized":"2020-11-20T11:29:32.184854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.811420+0000","last_change":"2020-11-20T11:29:31.810620+0000","last_active":"2020-11-20T11:29:31.811420+0000","last_peered":"2020-11-20T11:29:31.811420+0000","last_clean":"2020-11-20T11:29:31.811420+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:29:31.811420+0000","last_undegraded":"2020-11-20T11:29:31.811420+0000","last_fullsized":"2020-11-20T11:29:31.811420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.178287+0000","last_change":"2020-11-20T11:29:28.835613+0000","last_active":"2020-11-20T11:29:32.178287+0000","last_peered":"2020-11-20T11:29:32.178287+0000","last_clean":"2020-11-20T11:29:32.178287+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:29:32.178287+0000","last_undegraded":"2020-11-20T11:29:32.178287+0000","last_fullsized":"2020-11-20T11:29:32.178287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.788241+0000","last_change":"2020-11-20T11:29:26.041682+0000","last_active":"2020-11-20T11:29:31.788241+0000","last_peered":"2020-11-20T11:29:31.788241+0000","last_clean":"2020-11-20T11:29:31.788241+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:29:31.788241+0000","last_undegraded":"2020-11-20T11:29:31.788241+0000","last_fullsized":"2020-11-20T11:29:31.788241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.843486+0000","last_change":"2020-11-20T11:29:31.843080+0000","last_active":"2020-11-20T11:29:31.843486+0000","last_peered":"2020-11-20T11:29:31.843486+0000","last_clean":"2020-11-20T11:29:31.843486+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:29:31.843486+0000","last_undegraded":"2020-11-20T11:29:31.843486+0000","last_fullsized":"2020-11-20T11:29:31.843486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793857+0000","last_change":"2020-11-20T11:29:25.765016+0000","last_active":"2020-11-20T11:29:31.793857+0000","last_peered":"2020-11-20T11:29:31.793857+0000","last_clean":"2020-11-20T11:29:31.793857+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:29:31.793857+0000","last_undegraded":"2020-11-20T11:29:31.793857+0000","last_fullsized":"2020-11-20T11:29:31.793857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:29:32.177678+0000","last_change":"2020-11-20T11:29:28.780167+0000","last_active":"2020-11-20T11:29:32.177678+0000","last_peered":"2020-11-20T11:29:32.177678+0000","last_clean":"2020-11-20T11:29:32.177678+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:29:32.177678+0000","last_undegraded":"2020-11-20T11:29:32.177678+0000","last_fullsized":"2020-11-20T11:29:32.177678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.887}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.917}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.04}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":138074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.804}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8320000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":1,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":299008,"data_stored":136413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0219999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9259999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1379999999999999}]}]}]}} 2020-11-20T11:29:44.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T11:29:44.286 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T11:29:44.286 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T11:29:44.287 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T11:29:44.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.407+0000 7f0ad0121700 1 Processor -- start 2020-11-20T11:29:44.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.407+0000 7f0ad0121700 1 -- start start 2020-11-20T11:29:44.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0ad0121700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ac814b390 0x7f0ac814df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0ad0121700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ac80bdda0 0x7f0ac8062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0ad0121700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80bfc10 con 0x7f0ac814b770 2020-11-20T11:29:44.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0ad0121700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac814eec0 con 0x7f0ac80bdda0 2020-11-20T11:29:44.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0ad0121700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac814e6e0 con 0x7f0ac814b390 2020-11-20T11:29:44.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.408+0000 7f0acdebd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ac814b390 0x7f0ac814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ac814b390 0x7f0ac814df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60154/0 (socket says 172.21.15.105:60154) 2020-11-20T11:29:44.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0ace6be700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ac80bdda0 0x7f0ac8062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 -- 172.21.15.105:0/272166194 learned_addr learned my addr 172.21.15.105:0/272166194 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:44.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 -- 172.21.15.105:0/272166194 >> v2:172.21.15.67:3300/0 conn(0x7f0ac80bdda0 msgr2=0x7f0ac8062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:44.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 --2- 172.21.15.105:0/272166194 >> v2:172.21.15.67:3300/0 conn(0x7f0ac80bdda0 0x7f0ac8062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.416 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 -- 172.21.15.105:0/272166194 >> v1:172.21.15.67:6789/0 conn(0x7f0ac814b770 legacy=0x7f0ac80c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.417 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 -- 172.21.15.105:0/272166194 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac814e980 con 0x7f0ac814b390 2020-11-20T11:29:44.417 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0acdebd700 1 --2- 172.21.15.105:0/272166194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b390 0x7f0ac814df20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0ac80c36a0 tx=0x7f0ab8006eb0).ready entity=mon.1 client_cookie=7d69ea64f3913915 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.417 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0accebb700 1 -- 172.21.15.105:0/272166194 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8009810 con 0x7f0ac814b390 2020-11-20T11:29:44.417 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0accebb700 1 -- 172.21.15.105:0/272166194 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8009970 con 0x7f0ac814b390 2020-11-20T11:29:44.417 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0accebb700 1 -- 172.21.15.105:0/272166194 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8009cf0 con 0x7f0ac814b390 2020-11-20T11:29:44.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0ad0121700 1 -- 172.21.15.105:0/272166194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b390 msgr2=0x7f0ac814df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.409+0000 7f0ad0121700 1 --2- 172.21.15.105:0/272166194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b390 0x7f0ac814df20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0ac80c36a0 tx=0x7f0ab8006eb0).stop 2020-11-20T11:29:44.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 -- 172.21.15.105:0/272166194 shutdown_connections 2020-11-20T11:29:44.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 --2- 172.21.15.105:0/272166194 >> v2:172.21.15.67:3300/0 conn(0x7f0ac80bdda0 0x7f0ac8062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 --2- 172.21.15.105:0/272166194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b390 0x7f0ac814df20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 -- 172.21.15.105:0/272166194 >> 172.21.15.105:0/272166194 conn(0x7f0ac80b9910 msgr2=0x7f0ac80b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 -- 172.21.15.105:0/272166194 shutdown_connections 2020-11-20T11:29:44.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.410+0000 7f0ad0121700 1 -- 172.21.15.105:0/272166194 wait complete. 2020-11-20T11:29:44.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 Processor -- start 2020-11-20T11:29:44.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 -- start start 2020-11-20T11:29:44.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ac80bdda0 0x7f0ac80c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b770 0x7f0ac8135c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8134dc0 con 0x7f0ac80bdda0 2020-11-20T11:29:44.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac814a800 con 0x7f0ac814b770 2020-11-20T11:29:44.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.411+0000 7f0ad0121700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac814aaa0 con 0x7f0ac814b390 2020-11-20T11:29:44.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42034/0 (socket says 172.21.15.105:42034) 2020-11-20T11:29:44.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 -- 172.21.15.105:0/3592399167 learned_addr learned my addr 172.21.15.105:0/3592399167 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:44.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acdebd700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ac80bdda0 0x7f0ac80c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ace6be700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b770 0x7f0ac8135c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.425 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 -- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b770 msgr2=0x7f0ac8135c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.425 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b770 0x7f0ac8135c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.425 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 -- 172.21.15.105:0/3592399167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ac80bdda0 msgr2=0x7f0ac80c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.425 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ac80bdda0 0x7f0ac80c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.425 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 -- 172.21.15.105:0/3592399167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8134ff0 con 0x7f0ac814b390 2020-11-20T11:29:44.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0acd6bc700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0ac400c710 tx=0x7f0ac4007c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400e490 con 0x7f0ac814b390 2020-11-20T11:29:44.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400e5f0 con 0x7f0ac814b390 2020-11-20T11:29:44.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac8135290 con 0x7f0ac814b390 2020-11-20T11:29:44.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400e990 con 0x7f0ac814b390 2020-11-20T11:29:44.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.412+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac814a4f0 con 0x7f0ac814b390 2020-11-20T11:29:44.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.413+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8135420 con 0x7f0ac814b390 2020-11-20T11:29:44.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.414+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0ac4010070 con 0x7f0ac814b390 2020-11-20T11:29:44.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.414+0000 7f0ab5ffb700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 0x7f0aa4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.414+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0ac40a1e40 con 0x7f0ac814b390 2020-11-20T11:29:44.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.414+0000 7f0acdebd700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 0x7f0aa4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.415+0000 7f0acdebd700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 0x7f0aa4082af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0ab8006ef0 tx=0x7f0ab8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.418+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0ac4076850 con 0x7f0ac814b390 2020-11-20T11:29:44.649 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.646+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ac8044f60 con 0x7f0ac814b390 2020-11-20T11:29:44.650 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.646+0000 7f0ab5ffb700 1 -- 172.21.15.105:0/3592399167 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f0ac4079e70 con 0x7f0ac814b390 2020-11-20T11:29:44.650 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:44.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 msgr2=0x7f0aa4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 0x7f0aa4082af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0ab8006ef0 tx=0x7f0ab8015000).stop 2020-11-20T11:29:44.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 msgr2=0x7f0ac8135730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0ac400c710 tx=0x7f0ac4007c00).stop 2020-11-20T11:29:44.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 shutdown_connections 2020-11-20T11:29:44.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac814b770 0x7f0ac8135c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ac80bdda0 0x7f0ac80c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0aa4080630 0x7f0aa4082af0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 --2- 172.21.15.105:0/3592399167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ac814b390 0x7f0ac8135730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.647+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 >> 172.21.15.105:0/3592399167 conn(0x7f0ac80b9910 msgr2=0x7f0ac814def0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.648+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 shutdown_connections 2020-11-20T11:29:44.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.648+0000 7f0ad0121700 1 -- 172.21.15.105:0/3592399167 wait complete. 2020-11-20T11:29:44.662 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T11:29:44.662 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T11:29:44.663 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:44.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.780+0000 7f604f756700 1 Processor -- start 2020-11-20T11:29:44.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.780+0000 7f604f756700 1 -- start start 2020-11-20T11:29:44.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604f756700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f604814e2d0 0x7f60480c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604f756700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6048061d20 con 0x7f60480bfd60 2020-11-20T11:29:44.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604f756700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604814d790 con 0x7f60481518e0 2020-11-20T11:29:44.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604f756700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60480be1c0 con 0x7f604814e2d0 2020-11-20T11:29:44.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604dcf3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f604814e2d0 0x7f60480c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604dcf3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f604814e2d0 0x7f60480c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42044/0 (socket says 172.21.15.105:42044) 2020-11-20T11:29:44.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604dcf3700 1 -- 172.21.15.105:0/4029648833 learned_addr learned my addr 172.21.15.105:0/4029648833 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:44.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.781+0000 7f604d4f2700 1 --1- 172.21.15.105:0/4029648833 >> v1:172.21.15.67:6789/0 conn(0x7f60480bfd60 0x7f6048067430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:53106/0 (socket says 172.21.15.105:53106) 2020-11-20T11:29:44.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604dcf3700 1 -- 172.21.15.105:0/4029648833 >> v1:172.21.15.100:6789/0 conn(0x7f60481518e0 legacy=0x7f604814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604dcf3700 1 -- 172.21.15.105:0/4029648833 >> v1:172.21.15.67:6789/0 conn(0x7f60480bfd60 legacy=0x7f6048067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f6037fff700 1 -- 172.21.15.105:0/4029648833 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268167901 0 0) 0x7f6048061d20 con 0x7f60480bfd60 2020-11-20T11:29:44.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604dcf3700 1 -- 172.21.15.105:0/4029648833 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480be460 con 0x7f604814e2d0 2020-11-20T11:29:44.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604dcf3700 1 --2- 172.21.15.105:0/4029648833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f60480c0140 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6040009d50 tx=0x7f6040009290).ready entity=mon.2 client_cookie=ef1d67f72ab739ce server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f6037fff700 1 -- 172.21.15.105:0/4029648833 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000bc80 con 0x7f604814e2d0 2020-11-20T11:29:44.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f6037fff700 1 -- 172.21.15.105:0/4029648833 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000bde0 con 0x7f604814e2d0 2020-11-20T11:29:44.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f6037fff700 1 -- 172.21.15.105:0/4029648833 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011610 con 0x7f604814e2d0 2020-11-20T11:29:44.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 -- 172.21.15.105:0/4029648833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 msgr2=0x7f60480c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 --2- 172.21.15.105:0/4029648833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f60480c0140 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6040009d50 tx=0x7f6040009290).stop 2020-11-20T11:29:44.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 -- 172.21.15.105:0/4029648833 shutdown_connections 2020-11-20T11:29:44.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 --2- 172.21.15.105:0/4029648833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f60480c0140 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 -- 172.21.15.105:0/4029648833 >> 172.21.15.105:0/4029648833 conn(0x7f60480b9910 msgr2=0x7f60480b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 -- 172.21.15.105:0/4029648833 shutdown_connections 2020-11-20T11:29:44.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.782+0000 7f604f756700 1 -- 172.21.15.105:0/4029648833 wait complete. 2020-11-20T11:29:44.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 Processor -- start 2020-11-20T11:29:44.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 -- start start 2020-11-20T11:29:44.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60480bfd60 0x7f6048161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60481518e0 0x7f60481617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60481447d0 con 0x7f60480bfd60 2020-11-20T11:29:44.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048144a00 con 0x7f60481518e0 2020-11-20T11:29:44.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604f756700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048144ca0 con 0x7f604814e2d0 2020-11-20T11:29:44.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.784+0000 7f604ccf1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.799 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42048/0 (socket says 172.21.15.105:42048) 2020-11-20T11:29:44.799 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 -- 172.21.15.105:0/2655242723 learned_addr learned my addr 172.21.15.105:0/2655242723 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:44.799 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604d4f2700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60480bfd60 0x7f6048161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.799 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604dcf3700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60481518e0 0x7f60481617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.799 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 -- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60481518e0 msgr2=0x7f60481617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.800 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60481518e0 0x7f60481617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.800 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 -- 172.21.15.105:0/2655242723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60480bfd60 msgr2=0x7f6048161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.800 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60480bfd60 0x7f6048161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.800 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 -- 172.21.15.105:0/2655242723 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048144f40 con 0x7f604814e2d0 2020-11-20T11:29:44.800 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604ccf1700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f604400c710 tx=0x7f6044007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.801 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044007020 con 0x7f604814e2d0 2020-11-20T11:29:44.801 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044007180 con 0x7f604814e2d0 2020-11-20T11:29:44.801 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6048160760 con 0x7f604814e2d0 2020-11-20T11:29:44.801 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440064f0 con 0x7f604814e2d0 2020-11-20T11:29:44.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.785+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6048160ca0 con 0x7f604814e2d0 2020-11-20T11:29:44.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.786+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6048160e60 con 0x7f604814e2d0 2020-11-20T11:29:44.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.787+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f604401a060 con 0x7f604814e2d0 2020-11-20T11:29:44.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.787+0000 7f60357fa700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 0x7f6024082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:44.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.787+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f60440a2220 con 0x7f604814e2d0 2020-11-20T11:29:44.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.787+0000 7f604d4f2700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 0x7f6024082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:44.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.788+0000 7f604d4f2700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 0x7f6024082af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f60380011a0 tx=0x7f6038007a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:44.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.790+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6044076c30 con 0x7f604814e2d0 2020-11-20T11:29:44.963 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.960+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6048044f60 con 0x7f604814e2d0 2020-11-20T11:29:44.964 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.961+0000 7f60357fa700 1 -- 172.21.15.105:0/2655242723 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f604407a250 con 0x7f604814e2d0 2020-11-20T11:29:44.964 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:44.965 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:44.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 msgr2=0x7f6024082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.966 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 0x7f6024082af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f60380011a0 tx=0x7f6038007a00).stop 2020-11-20T11:29:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 msgr2=0x7f6048145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f604400c710 tx=0x7f6044007c20).stop 2020-11-20T11:29:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 shutdown_connections 2020-11-20T11:29:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60481518e0 0x7f60481617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60480bfd60 0x7f6048161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6024080630 0x7f6024082af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 --2- 172.21.15.105:0/2655242723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604814e2d0 0x7f6048145bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 >> 172.21.15.105:0/2655242723 conn(0x7f60480b9910 msgr2=0x7f6048143480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 shutdown_connections 2020-11-20T11:29:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:44.962+0000 7f604f756700 1 -- 172.21.15.105:0/2655242723 wait complete. 2020-11-20T11:29:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:29:11.234336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:29:24.196669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:29:27.352951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:29:29.818965+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:29:44.978 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:29:45.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.095+0000 7fbfb28e0700 1 Processor -- start 2020-11-20T11:29:45.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.095+0000 7fbfb28e0700 1 -- start start 2020-11-20T11:29:45.104 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb28e0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbfac14b410 0x7fbfac065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.104 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb28e0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac0bde30 con 0x7fbfac09ad30 2020-11-20T11:29:45.104 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb28e0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac14de60 con 0x7fbfac0c3a10 2020-11-20T11:29:45.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb28e0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0beae0 con 0x7fbfac14b410 2020-11-20T11:29:45.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb0e7d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbfac0c3a10 0x7fbfac14e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41658/0 (socket says 172.21.15.105:41658) 2020-11-20T11:29:45.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/1506137173 learned_addr learned my addr 172.21.15.105:0/1506137173 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:45.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914437965 0 0) 0x7fbfa4001450 con 0x7fbfac0c3a10 2020-11-20T11:29:45.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf98003240 con 0x7fbfac0c3a10 2020-11-20T11:29:45.106 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfabfff700 1 --2- 172.21.15.105:0/1506137173 >> v2:172.21.15.67:3300/0 conn(0x7fbfac14b410 0x7fbfac065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.106 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 760162704 0 0) 0x7fbf98003240 con 0x7fbfac0c3a10 2020-11-20T11:29:45.106 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 >> v2:172.21.15.67:3300/0 conn(0x7fbfac14b410 msgr2=0x7fbfac065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:45.106 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 --2- 172.21.15.105:0/1506137173 >> v2:172.21.15.67:3300/0 conn(0x7fbfac14b410 0x7fbfac065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.107 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 >> v1:172.21.15.67:6789/0 conn(0x7fbfac09ad30 legacy=0x7fbfac0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.107 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0be060 con 0x7fbfac0c3a10 2020-11-20T11:29:45.107 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fbfa40019f0 con 0x7fbfac0c3a10 2020-11-20T11:29:45.107 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 >> v1:172.21.15.105:6789/0 conn(0x7fbfac0c3a10 legacy=0x7fbfac14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.107 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98003780 0x7fbf98003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.108 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf980044e0 0x7fbf98004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.108 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 0x7fbf9800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.108 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98005300 con 0x7fbf980044e0 2020-11-20T11:29:45.108 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9800bc20 con 0x7fbf98003780 2020-11-20T11:29:45.108 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9800bd60 con 0x7fbf98004e50 2020-11-20T11:29:45.109 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.096+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 0x7fbf9800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.109 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfab7fe700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf980044e0 0x7fbf98004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.109 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfabfff700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98003780 0x7fbf98003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.109 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/1506137173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98003780 msgr2=0x7fbf98003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:45.109 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98003780 0x7fbf98003ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.110 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/1506137173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf980044e0 msgr2=0x7fbf98004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:45.110 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf980044e0 0x7fbf98004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.110 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/1506137173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98003240 con 0x7fbf98004e50 2020-11-20T11:29:45.110 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/1506137173 reap_dead start 2020-11-20T11:29:45.110 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 0x7fbf9800b730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbfa4002210 tx=0x7fbfac0be1f0).ready entity=mon.2 client_cookie=ed6b5dba92034d2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.111 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4005b80 con 0x7fbf98004e50 2020-11-20T11:29:45.111 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4005d00 con 0x7fbf98004e50 2020-11-20T11:29:45.111 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfaaffd700 1 -- 172.21.15.105:0/1506137173 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4007360 con 0x7fbf98004e50 2020-11-20T11:29:45.111 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 -- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 msgr2=0x7fbf9800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.112 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 0x7fbf9800b730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbfa4002210 tx=0x7fbfac0be1f0).stop 2020-11-20T11:29:45.112 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 -- 172.21.15.105:0/1506137173 shutdown_connections 2020-11-20T11:29:45.112 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/1506137173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf98004e50 0x7fbf9800b730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.112 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 -- 172.21.15.105:0/1506137173 >> 172.21.15.105:0/1506137173 conn(0x7fbfac0b9890 msgr2=0x7fbfac0b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.112 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.097+0000 7fbfb28e0700 1 -- 172.21.15.105:0/1506137173 shutdown_connections 2020-11-20T11:29:45.113 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.098+0000 7fbfb28e0700 1 -- 172.21.15.105:0/1506137173 wait complete. 2020-11-20T11:29:45.113 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 Processor -- start 2020-11-20T11:29:45.113 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 -- start start 2020-11-20T11:29:45.113 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf98004e50 0x7fbfac0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.113 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfac0c1c90 0x7fbfac148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1458f0 con 0x7fbf98004e50 2020-11-20T11:29:45.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac145b90 con 0x7fbfac0c1c90 2020-11-20T11:29:45.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.099+0000 7fbfb28e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac145e30 con 0x7fbfac148a80 2020-11-20T11:29:45.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.115 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42070/0 (socket says 172.21.15.105:42070) 2020-11-20T11:29:45.115 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/780332983 learned_addr learned my addr 172.21.15.105:0/780332983 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:45.115 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfabfff700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf98004e50 0x7fbfac0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.115 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfab7fe700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfac0c1c90 0x7fbfac148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.115 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfac0c1c90 msgr2=0x7fbfac148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfac0c1c90 0x7fbfac148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/780332983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf98004e50 msgr2=0x7fbfac0c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf98004e50 0x7fbfac0c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 -- 172.21.15.105:0/780332983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac1460d0 con 0x7fbfac148a80 2020-11-20T11:29:45.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb0e7d700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fbfa4000f40 tx=0x7fbfa4014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004ce0 con 0x7fbfac148a80 2020-11-20T11:29:45.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4004e40 con 0x7fbfac148a80 2020-11-20T11:29:45.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac146370 con 0x7fbfac148a80 2020-11-20T11:29:45.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4013660 con 0x7fbfac148a80 2020-11-20T11:29:45.118 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.100+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac14b880 con 0x7fbfac148a80 2020-11-20T11:29:45.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.101+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac146500 con 0x7fbfac148a80 2020-11-20T11:29:45.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.102+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbfa4010030 con 0x7fbfac148a80 2020-11-20T11:29:45.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.102+0000 7fbf8bfff700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 0x7fbf84082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.102+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbfa40a3100 con 0x7fbfac148a80 2020-11-20T11:29:45.120 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.102+0000 7fbfabfff700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 0x7fbf84082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.120 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.103+0000 7fbfabfff700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 0x7fbf84082b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbf9c006a50 tx=0x7fbf9c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.120 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.106+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbfa4077a90 con 0x7fbfac148a80 2020-11-20T11:29:45.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.269+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbfac14de60 con 0x7fbfac148a80 2020-11-20T11:29:45.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.269+0000 7fbf8bfff700 1 -- 172.21.15.105:0/780332983 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbfac14de60 con 0x7fbfac148a80 2020-11-20T11:29:45.273 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2020-11-20T11:29:45.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 msgr2=0x7fbf84082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 0x7fbf84082b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbf9c006a50 tx=0x7fbf9c008040).stop 2020-11-20T11:29:45.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 msgr2=0x7fbfac14bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fbfa4000f40 tx=0x7fbfa4014000).stop 2020-11-20T11:29:45.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 shutdown_connections 2020-11-20T11:29:45.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fbf84080660 0x7fbf84082b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfac148a80 0x7fbfac14bd80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf98004e50 0x7fbfac0c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 --2- 172.21.15.105:0/780332983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfac0c1c90 0x7fbfac148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.276 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 >> 172.21.15.105:0/780332983 conn(0x7fbfac0b9890 msgr2=0x7fbfac0bfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 shutdown_connections 2020-11-20T11:29:45.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.271+0000 7fbfb28e0700 1 -- 172.21.15.105:0/780332983 wait complete. 2020-11-20T11:29:45.286 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:29:45.408 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.404+0000 7fee1c103700 1 Processor -- start 2020-11-20T11:29:45.408 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.405+0000 7fee1c103700 1 -- start start 2020-11-20T11:29:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.405+0000 7fee1c103700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee140c3a10 0x7fee1414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.405+0000 7fee1c103700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee140bde30 con 0x7fee1414b410 2020-11-20T11:29:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.405+0000 7fee1c103700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1414de60 con 0x7fee1409ad30 2020-11-20T11:29:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.405+0000 7fee1c103700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee140beae0 con 0x7fee140c3a10 2020-11-20T11:29:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1969e700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fee1409ad30 0x7fee140c3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60694/0 (socket says 172.21.15.105:60694) 2020-11-20T11:29:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1969e700 1 -- 172.21.15.105:0/2927366945 learned_addr learned my addr 172.21.15.105:0/2927366945 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1a6a0700 1 --2- 172.21.15.105:0/2927366945 >> v2:172.21.15.67:3300/0 conn(0x7fee140c3a10 0x7fee1414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722774965 0 0) 0x7fee10001120 con 0x7fee1409ad30 2020-11-20T11:29:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc003240 con 0x7fee1409ad30 2020-11-20T11:29:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857115465 0 0) 0x7fee140bde30 con 0x7fee1414b410 2020-11-20T11:29:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee10001120 con 0x7fee1414b410 2020-11-20T11:29:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1a6a0700 1 -- 172.21.15.105:0/2927366945 >> v1:172.21.15.100:6789/0 conn(0x7fee1409ad30 legacy=0x7fee140c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2955798504 0 0) 0x7fedfc003240 con 0x7fee1409ad30 2020-11-20T11:29:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1a6a0700 1 -- 172.21.15.105:0/2927366945 >> v1:172.21.15.67:6789/0 conn(0x7fee1414b410 legacy=0x7fee14065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1a6a0700 1 -- 172.21.15.105:0/2927366945 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140be060 con 0x7fee140c3a10 2020-11-20T11:29:45.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.406+0000 7fee1a6a0700 1 --2- 172.21.15.105:0/2927366945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee140c3a10 0x7fee1414e2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fee0c009c10 tx=0x7fee0c0091d0).ready entity=mon.0 client_cookie=cf311d718646fc53 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100016c0 con 0x7fee140c3a10 2020-11-20T11:29:45.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00b730 con 0x7fee140c3a10 2020-11-20T11:29:45.414 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee18e9d700 1 -- 172.21.15.105:0/2927366945 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00bab0 con 0x7fee140c3a10 2020-11-20T11:29:45.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 -- 172.21.15.105:0/2927366945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee140c3a10 msgr2=0x7fee1414e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 --2- 172.21.15.105:0/2927366945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee140c3a10 0x7fee1414e2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fee0c009c10 tx=0x7fee0c0091d0).stop 2020-11-20T11:29:45.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 -- 172.21.15.105:0/2927366945 shutdown_connections 2020-11-20T11:29:45.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 --2- 172.21.15.105:0/2927366945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee140c3a10 0x7fee1414e2a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.415 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 -- 172.21.15.105:0/2927366945 >> 172.21.15.105:0/2927366945 conn(0x7fee140b9890 msgr2=0x7fee140b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 -- 172.21.15.105:0/2927366945 shutdown_connections 2020-11-20T11:29:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.407+0000 7fee1c103700 1 -- 172.21.15.105:0/2927366945 wait complete. 2020-11-20T11:29:45.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.408+0000 7fee1c103700 1 Processor -- start 2020-11-20T11:29:45.418 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.408+0000 7fee1c103700 1 -- start start 2020-11-20T11:29:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee1409ad30 0x7fee14142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee140c3a10 0x7fee1413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee14144420 con 0x7fee1409ad30 2020-11-20T11:29:45.420 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1413d930 con 0x7fee140c3a10 2020-11-20T11:29:45.420 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1c103700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee14144f60 con 0x7fee1414b410 2020-11-20T11:29:45.420 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.420 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1969e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee140c3a10 0x7fee1413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.420 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42082/0 (socket says 172.21.15.105:42082) 2020-11-20T11:29:45.421 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 -- 172.21.15.105:0/795809897 learned_addr learned my addr 172.21.15.105:0/795809897 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:45.421 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee19e9f700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee1409ad30 0x7fee14142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.421 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 -- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee140c3a10 msgr2=0x7fee1413be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.421 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee140c3a10 0x7fee1413be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.421 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 -- 172.21.15.105:0/795809897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee1409ad30 msgr2=0x7fee14142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee1409ad30 0x7fee14142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 -- 172.21.15.105:0/795809897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1413d690 con 0x7fee1414b410 2020-11-20T11:29:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.409+0000 7fee1a6a0700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fee14068320 tx=0x7fee0c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.410+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c01d450 con 0x7fee1414b410 2020-11-20T11:29:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.410+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c01d5b0 con 0x7fee1414b410 2020-11-20T11:29:45.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.410+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee14144610 con 0x7fee1414b410 2020-11-20T11:29:45.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.410+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c01d930 con 0x7fee1414b410 2020-11-20T11:29:45.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.410+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14144b50 con 0x7fee1414b410 2020-11-20T11:29:45.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.411+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee14044f60 con 0x7fee1414b410 2020-11-20T11:29:45.423 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.411+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fee0c02d070 con 0x7fee1414b410 2020-11-20T11:29:45.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.412+0000 7fee01ffb700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 0x7fedec082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.412+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fee0c0a4f70 con 0x7fee1414b410 2020-11-20T11:29:45.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.412+0000 7fee19e9f700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 0x7fedec082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.412+0000 7fee19e9f700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 0x7fedec082b20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fee04003740 tx=0x7fee04007a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.415+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fee0c079900 con 0x7fee1414b410 2020-11-20T11:29:45.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.577+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee1414acb0 con 0x7fee1414b410 2020-11-20T11:29:45.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.577+0000 7fee01ffb700 1 -- 172.21.15.105:0/795809897 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee0c015030 con 0x7fee1414b410 2020-11-20T11:29:45.581 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:45.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 msgr2=0x7fedec082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 0x7fedec082b20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fee04003740 tx=0x7fee04007a20).stop 2020-11-20T11:29:45.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 msgr2=0x7fee14061d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fee14068320 tx=0x7fee0c016000).stop 2020-11-20T11:29:45.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 shutdown_connections 2020-11-20T11:29:45.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.578+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fedec080660 0x7fedec082b20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee1414b410 0x7fee14061d00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee1409ad30 0x7fee14142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 --2- 172.21.15.105:0/795809897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee140c3a10 0x7fee1413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 >> 172.21.15.105:0/795809897 conn(0x7fee140b9890 msgr2=0x7fee141417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 shutdown_connections 2020-11-20T11:29:45.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.579+0000 7fee1c103700 1 -- 172.21.15.105:0/795809897 wait complete. 2020-11-20T11:29:45.593 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:29:45.712 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.708+0000 7f642f59e700 1 Processor -- start 2020-11-20T11:29:45.712 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.708+0000 7f642f59e700 1 -- start start 2020-11-20T11:29:45.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64300bcd40 0x7f64300bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f64300ba3b0 0x7f6430151d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6430065580 0x7f64300659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6430065ec0 con 0x7f64300ba3b0 2020-11-20T11:29:45.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300bbdf0 con 0x7f64300bcd40 2020-11-20T11:29:45.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642f59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300bc7c0 con 0x7f6430065580 2020-11-20T11:29:45.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642ed9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6430065580 0x7f64300659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642ed9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6430065580 0x7f64300659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42088/0 (socket says 172.21.15.105:42088) 2020-11-20T11:29:45.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.709+0000 7f642ed9d700 1 -- 172.21.15.105:0/3494005429 learned_addr learned my addr 172.21.15.105:0/3494005429 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:45.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642e59c700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.100:3300/0 conn(0x7f64300bcd40 0x7f64300bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642dd9b700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.67:3300/0 conn(0x7f64300ba3b0 0x7f6430151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 -- 172.21.15.105:0/3494005429 >> v2:172.21.15.100:3300/0 conn(0x7f64300bcd40 msgr2=0x7f64300bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:45.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.100:3300/0 conn(0x7f64300bcd40 0x7f64300bd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 -- 172.21.15.105:0/3494005429 >> v2:172.21.15.67:3300/0 conn(0x7f64300ba3b0 msgr2=0x7f6430151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:45.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.67:3300/0 conn(0x7f64300ba3b0 0x7f6430151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 -- 172.21.15.105:0/3494005429 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430152280 con 0x7f6430065580 2020-11-20T11:29:45.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3494005429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6430065580 0x7f64300659d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f64300c4280 tx=0x7f6428009290).ready entity=mon.2 client_cookie=83a903f30be2cfd6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.720 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642d59a700 1 -- 172.21.15.105:0/3494005429 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800bb80 con 0x7f6430065580 2020-11-20T11:29:45.720 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642d59a700 1 -- 172.21.15.105:0/3494005429 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800bce0 con 0x7f6430065580 2020-11-20T11:29:45.720 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642d59a700 1 -- 172.21.15.105:0/3494005429 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428011610 con 0x7f6430065580 2020-11-20T11:29:45.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 -- 172.21.15.105:0/3494005429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6430065580 msgr2=0x7f64300659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 --2- 172.21.15.105:0/3494005429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6430065580 0x7f64300659d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f64300c4280 tx=0x7f6428009290).stop 2020-11-20T11:29:45.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 -- 172.21.15.105:0/3494005429 shutdown_connections 2020-11-20T11:29:45.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 --2- 172.21.15.105:0/3494005429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6430065580 0x7f64300659d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.100:3300/0 conn(0x7f64300bcd40 0x7f64300bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 --2- 172.21.15.105:0/3494005429 >> v2:172.21.15.67:3300/0 conn(0x7f64300ba3b0 0x7f6430151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.710+0000 7f642f59e700 1 -- 172.21.15.105:0/3494005429 >> 172.21.15.105:0/3494005429 conn(0x7f6430067780 msgr2=0x7f6430025a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.711+0000 7f642f59e700 1 -- 172.21.15.105:0/3494005429 shutdown_connections 2020-11-20T11:29:45.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.711+0000 7f642f59e700 1 -- 172.21.15.105:0/3494005429 wait complete. 2020-11-20T11:29:45.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 Processor -- start 2020-11-20T11:29:45.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 -- start start 2020-11-20T11:29:45.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6430065580 0x7f6430147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64300ba3b0 0x7f64300ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643015f2a0 con 0x7f6430065580 2020-11-20T11:29:45.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643015f540 con 0x7f64300ba3b0 2020-11-20T11:29:45.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642f59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643015f7e0 con 0x7f64300bcd40 2020-11-20T11:29:45.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642ed9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642ed9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42096/0 (socket says 172.21.15.105:42096) 2020-11-20T11:29:45.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.712+0000 7f642ed9d700 1 -- 172.21.15.105:0/3525100932 learned_addr learned my addr 172.21.15.105:0/3525100932 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:45.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642dd9b700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64300ba3b0 0x7f64300ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642e59c700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6430065580 0x7f6430147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 -- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64300ba3b0 msgr2=0x7f64300ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64300ba3b0 0x7f64300ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 -- 172.21.15.105:0/3525100932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6430065580 msgr2=0x7f6430147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6430065580 0x7f6430147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 -- 172.21.15.105:0/3525100932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643015fa80 con 0x7f64300bcd40 2020-11-20T11:29:45.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642ed9d700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f64280092d0 tx=0x7f6428016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428020070 con 0x7f64300bcd40 2020-11-20T11:29:45.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800be50 con 0x7f64300bcd40 2020-11-20T11:29:45.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643015fd20 con 0x7f64300bcd40 2020-11-20T11:29:45.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800bb80 con 0x7f64300bcd40 2020-11-20T11:29:45.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.713+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64300ad0f0 con 0x7f64300bcd40 2020-11-20T11:29:45.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.714+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643005ca10 con 0x7f64300bcd40 2020-11-20T11:29:45.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.715+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6428017070 con 0x7f64300bcd40 2020-11-20T11:29:45.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.715+0000 7f641e7fc700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 0x7f6404082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:45.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.715+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f64280a4710 con 0x7f64300bcd40 2020-11-20T11:29:45.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.715+0000 7f642e59c700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 0x7f6404082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:45.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.716+0000 7f642e59c700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 0x7f6404082af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6424006bd0 tx=0x7f6424008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:45.729 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.719+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6428079120 con 0x7f64300bcd40 2020-11-20T11:29:45.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.886+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6430062e30 con 0x7f64300bcd40 2020-11-20T11:29:45.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.886+0000 7f641e7fc700 1 -- 172.21.15.105:0/3525100932 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7f642807c740 con 0x7f64300bcd40 2020-11-20T11:29:45.890 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:45.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 msgr2=0x7f6404082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 0x7f6404082af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6424006bd0 tx=0x7f6424008040).stop 2020-11-20T11:29:45.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 msgr2=0x7f64300acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:45.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f64280092d0 tx=0x7f6428016000).stop 2020-11-20T11:29:45.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 shutdown_connections 2020-11-20T11:29:45.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6404080630 0x7f6404082af0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300bcd40 0x7f64300acc00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6430065580 0x7f6430147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 --2- 172.21.15.105:0/3525100932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64300ba3b0 0x7f64300ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:45.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 >> 172.21.15.105:0/3525100932 conn(0x7f6430067780 msgr2=0x7f64301491e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:45.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 shutdown_connections 2020-11-20T11:29:45.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:45.888+0000 7f642f59e700 1 -- 172.21.15.105:0/3525100932 wait complete. 2020-11-20T11:29:45.902 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:29:46.023 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.019+0000 7f27d89d5700 1 Processor -- start 2020-11-20T11:29:46.023 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.019+0000 7f27d89d5700 1 -- start start 2020-11-20T11:29:46.026 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d89d5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d40beed0 0x7f27d40bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.026 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d89d5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27d4066b30 0x7f27d4066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.026 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d89d5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4158b20 con 0x7f27d4067490 2020-11-20T11:29:46.027 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d89d5700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d4158dc0 con 0x7f27d4066b30 2020-11-20T11:29:46.027 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d89d5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d4159060 con 0x7f27d40beed0 2020-11-20T11:29:46.027 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d40beed0 0x7f27d40bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d40beed0 0x7f27d40bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42100/0 (socket says 172.21.15.105:42100) 2020-11-20T11:29:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27d259c700 1 -- 172.21.15.105:0/2437857547 learned_addr learned my addr 172.21.15.105:0/2437857547 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.020+0000 7f27cbfff700 1 --2- 172.21.15.105:0/2437857547 >> v2:172.21.15.100:3300/0 conn(0x7f27d4066b30 0x7f27d4066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.029 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d259c700 1 -- 172.21.15.105:0/2437857547 >> v2:172.21.15.100:3300/0 conn(0x7f27d4066b30 msgr2=0x7f27d4066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:46.029 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d259c700 1 --2- 172.21.15.105:0/2437857547 >> v2:172.21.15.100:3300/0 conn(0x7f27d4066b30 0x7f27d4066fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.029 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d259c700 1 -- 172.21.15.105:0/2437857547 >> v1:172.21.15.67:6789/0 conn(0x7f27d4067490 legacy=0x7f27d41556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:46.029 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d259c700 1 -- 172.21.15.105:0/2437857547 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4159300 con 0x7f27d40beed0 2020-11-20T11:29:46.030 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d259c700 1 --2- 172.21.15.105:0/2437857547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d40bf2b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27d4026ed0 tx=0x7f27c4006eb0).ready entity=mon.2 client_cookie=59b74081b4fc8e34 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.030 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d1d9b700 1 -- 172.21.15.105:0/2437857547 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4009920 con 0x7f27d40beed0 2020-11-20T11:29:46.030 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d1d9b700 1 -- 172.21.15.105:0/2437857547 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4009a80 con 0x7f27d40beed0 2020-11-20T11:29:46.030 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d1d9b700 1 -- 172.21.15.105:0/2437857547 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4009e00 con 0x7f27d40beed0 2020-11-20T11:29:46.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 -- 172.21.15.105:0/2437857547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 msgr2=0x7f27d40bf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 --2- 172.21.15.105:0/2437857547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d40bf2b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27d4026ed0 tx=0x7f27c4006eb0).stop 2020-11-20T11:29:46.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 -- 172.21.15.105:0/2437857547 shutdown_connections 2020-11-20T11:29:46.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 --2- 172.21.15.105:0/2437857547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d40bf2b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.032 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 --2- 172.21.15.105:0/2437857547 >> v2:172.21.15.100:3300/0 conn(0x7f27d4066b30 0x7f27d4066fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.032 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 -- 172.21.15.105:0/2437857547 >> 172.21.15.105:0/2437857547 conn(0x7f27d40b9890 msgr2=0x7f27d40b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:46.032 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 -- 172.21.15.105:0/2437857547 shutdown_connections 2020-11-20T11:29:46.032 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.021+0000 7f27d89d5700 1 -- 172.21.15.105:0/2437857547 wait complete. 2020-11-20T11:29:46.033 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.022+0000 7f27d89d5700 1 Processor -- start 2020-11-20T11:29:46.033 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.022+0000 7f27d89d5700 1 -- start start 2020-11-20T11:29:46.036 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d4066b30 0x7f27d40bd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.037 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27d4067490 0x7f27d4154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.037 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.037 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4091400 con 0x7f27d4067490 2020-11-20T11:29:46.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d408eb70 con 0x7f27d4066b30 2020-11-20T11:29:46.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d89d5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d408ee10 con 0x7f27d40beed0 2020-11-20T11:29:46.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d2d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d2d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42110/0 (socket says 172.21.15.105:42110) 2020-11-20T11:29:46.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d2d9d700 1 -- 172.21.15.105:0/4149901620 learned_addr learned my addr 172.21.15.105:0/4149901620 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:46.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d259c700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d4066b30 0x7f27d40bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27cbfff700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27d4067490 0x7f27d4154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d2d9d700 1 -- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d4066b30 msgr2=0x7f27d40bd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.023+0000 7f27d2d9d700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d4066b30 0x7f27d40bd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d2d9d700 1 -- 172.21.15.105:0/4149901620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27d4067490 msgr2=0x7f27d4154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d2d9d700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27d4067490 0x7f27d4154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d2d9d700 1 -- 172.21.15.105:0/4149901620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d408f0b0 con 0x7f27d40beed0 2020-11-20T11:29:46.041 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d2d9d700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27cc00cae0 tx=0x7f27cc0023b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.041 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00a880 con 0x7f27d40beed0 2020-11-20T11:29:46.041 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc00a9e0 con 0x7f27d40beed0 2020-11-20T11:29:46.041 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d408f350 con 0x7f27d40beed0 2020-11-20T11:29:46.042 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00ad80 con 0x7f27d40beed0 2020-11-20T11:29:46.042 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.024+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d4154a50 con 0x7f27d40beed0 2020-11-20T11:29:46.042 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.025+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4068fc0 con 0x7f27d40beed0 2020-11-20T11:29:46.042 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.025+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f27cc019030 con 0x7f27d40beed0 2020-11-20T11:29:46.043 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.026+0000 7f27ca7fc700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 0x7f27b0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.043 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.026+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f27cc0a23e0 con 0x7f27d40beed0 2020-11-20T11:29:46.043 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.026+0000 7f27d259c700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 0x7f27b0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.044 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.026+0000 7f27d259c700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 0x7f27b0082af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f27c4006ef0 tx=0x7f27c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.044 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.029+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f27cc076df0 con 0x7f27d40beed0 2020-11-20T11:29:46.196 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.192+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27d4044f60 con 0x7f27d40beed0 2020-11-20T11:29:46.197 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.193+0000 7f27ca7fc700 1 -- 172.21.15.105:0/4149901620 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f27cc07a410 con 0x7f27d40beed0 2020-11-20T11:29:46.197 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:46.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 msgr2=0x7f27b0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 0x7f27b0082af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f27c4006ef0 tx=0x7f27c4015000).stop 2020-11-20T11:29:46.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 msgr2=0x7f27d4090860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27cc00cae0 tx=0x7f27cc0023b0).stop 2020-11-20T11:29:46.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 shutdown_connections 2020-11-20T11:29:46.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f27b0080630 0x7f27b0082af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d40beed0 0x7f27d4090860 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d4066b30 0x7f27d40bd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 --2- 172.21.15.105:0/4149901620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27d4067490 0x7f27d4154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 >> 172.21.15.105:0/4149901620 conn(0x7f27d40b9890 msgr2=0x7f27d4152460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:46.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 shutdown_connections 2020-11-20T11:29:46.202 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.194+0000 7f27d89d5700 1 -- 172.21.15.105:0/4149901620 wait complete. 2020-11-20T11:29:46.209 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:29:46.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.322+0000 7ff9d1bce700 1 Processor -- start 2020-11-20T11:29:46.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.322+0000 7ff9d1bce700 1 -- start start 2020-11-20T11:29:46.329 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9d1bce700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9cc14e2d0 0x7ff9cc0c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.329 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9d1bce700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc061d20 con 0x7ff9cc0bfd60 2020-11-20T11:29:46.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9d1bce700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc14d790 con 0x7ff9cc1518e0 2020-11-20T11:29:46.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9d1bce700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0be1c0 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9cbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9cc14e2d0 0x7ff9cc0c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9caffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff9cc1518e0 0x7ff9cc14dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41720/0 (socket says 172.21.15.105:41720) 2020-11-20T11:29:46.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9caffd700 1 -- 172.21.15.105:0/242907054 learned_addr learned my addr 172.21.15.105:0/242907054 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:46.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9cbfff700 1 -- 172.21.15.105:0/242907054 >> v1:172.21.15.105:6789/0 conn(0x7ff9cc1518e0 legacy=0x7ff9cc14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9cbfff700 1 -- 172.21.15.105:0/242907054 >> v1:172.21.15.100:6789/0 conn(0x7ff9cc0bfd60 legacy=0x7ff9cc067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9cbfff700 1 -- 172.21.15.105:0/242907054 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0be460 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9cbfff700 1 --2- 172.21.15.105:0/242907054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc0c0140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff9c4009c10 tx=0x7ff9c40091d0).ready entity=mon.2 client_cookie=14738b0a898ce72a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9ca7fc700 1 -- 172.21.15.105:0/242907054 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400ba50 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.333 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9ca7fc700 1 -- 172.21.15.105:0/242907054 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400bbb0 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.323+0000 7ff9ca7fc700 1 -- 172.21.15.105:0/242907054 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011400 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 -- 172.21.15.105:0/242907054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc14e2d0 msgr2=0x7ff9cc0c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/242907054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc0c0140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff9c4009c10 tx=0x7ff9c40091d0).stop 2020-11-20T11:29:46.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 -- 172.21.15.105:0/242907054 shutdown_connections 2020-11-20T11:29:46.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/242907054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc0c0140 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 -- 172.21.15.105:0/242907054 >> 172.21.15.105:0/242907054 conn(0x7ff9cc0b9910 msgr2=0x7ff9cc0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:46.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 -- 172.21.15.105:0/242907054 shutdown_connections 2020-11-20T11:29:46.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.324+0000 7ff9d1bce700 1 -- 172.21.15.105:0/242907054 wait complete. 2020-11-20T11:29:46.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.325+0000 7ff9d1bce700 1 Processor -- start 2020-11-20T11:29:46.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.325+0000 7ff9d1bce700 1 -- start start 2020-11-20T11:29:46.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9cc0bfd60 0x7ff9cc146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc146800 con 0x7ff9cc0bfd60 2020-11-20T11:29:46.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc15d2c0 con 0x7ff9cc14e2d0 2020-11-20T11:29:46.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9d1bce700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc15d560 con 0x7ff9cc1518e0 2020-11-20T11:29:46.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42124/0 (socket says 172.21.15.105:42124) 2020-11-20T11:29:46.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 -- 172.21.15.105:0/478119681 learned_addr learned my addr 172.21.15.105:0/478119681 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:46.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9caffd700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cb7fe700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9cc0bfd60 0x7ff9cc146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 -- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc14e2d0 msgr2=0x7ff9cc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 -- 172.21.15.105:0/478119681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9cc0bfd60 msgr2=0x7ff9cc146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9cc0bfd60 0x7ff9cc146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 -- 172.21.15.105:0/478119681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc15d800 con 0x7ff9cc1518e0 2020-11-20T11:29:46.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9cbfff700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff9c400a010 tx=0x7ff9c4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.326+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c401d730 con 0x7ff9cc1518e0 2020-11-20T11:29:46.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.327+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c401d890 con 0x7ff9cc1518e0 2020-11-20T11:29:46.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.327+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c401dc10 con 0x7ff9cc1518e0 2020-11-20T11:29:46.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.327+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc15daa0 con 0x7ff9cc1518e0 2020-11-20T11:29:46.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.327+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc144e20 con 0x7ff9cc1518e0 2020-11-20T11:29:46.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.328+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc15dc30 con 0x7ff9cc1518e0 2020-11-20T11:29:46.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.328+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff9c4017040 con 0x7ff9cc1518e0 2020-11-20T11:29:46.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.329+0000 7ff9ab7fe700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 0x7ff9a4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:46.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.329+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff9c40a5020 con 0x7ff9cc1518e0 2020-11-20T11:29:46.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.329+0000 7ff9cb7fe700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 0x7ff9a4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:46.347 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.329+0000 7ff9cb7fe700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 0x7ff9a4082b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff9bc003510 tx=0x7ff9bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:46.347 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.332+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff9c4079ac0 con 0x7ff9cc1518e0 2020-11-20T11:29:46.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.552+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9cc044f60 con 0x7ff9cc1518e0 2020-11-20T11:29:46.556 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.552+0000 7ff9ab7fe700 1 -- 172.21.15.105:0/478119681 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7ff9c4015030 con 0x7ff9cc1518e0 2020-11-20T11:29:46.556 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:46.556 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.100:6835/2752212696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2752212696},{"type":"v1","addr":"172.21.15.100:6835","nonce":2752212696}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4295,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2514469097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2514469097},{"type":"v1","addr":"172.21.15.105:6833","nonce":2514469097}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:29:32.164149+0000","modified":"2020-11-20T11:29:34.808094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/151091778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":151091778},{"type":"v1","addr":"172.21.15.67:6833","nonce":151091778}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:29:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 msgr2=0x7ff9a4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 0x7ff9a4082b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff9bc003510 tx=0x7ff9bc009040).stop 2020-11-20T11:29:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 msgr2=0x7ff9cc144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff9c400a010 tx=0x7ff9c4016000).stop 2020-11-20T11:29:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 shutdown_connections 2020-11-20T11:29:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7ff9a4080660 0x7ff9a4082b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9cc1518e0 0x7ff9cc144930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9cc0bfd60 0x7ff9cc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 --2- 172.21.15.105:0/478119681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc14e2d0 0x7ff9cc15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 >> 172.21.15.105:0/478119681 conn(0x7ff9cc0b9910 msgr2=0x7ff9cc143ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 shutdown_connections 2020-11-20T11:29:46.560 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:46.554+0000 7ff9d1bce700 1 -- 172.21.15.105:0/478119681 wait complete. 2020-11-20T11:29:46.560 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 7 2020-11-20T11:29:46.871 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:29:32.164149+0000', 'modified': '2020-11-20T11:29:34.808094+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4323': {'gid': 4323, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6833/151091778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 151091778}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 151091778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:29:46.872 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:29:46.872 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-11-20T11:29:47.033 INFO:teuthology.orchestra.run.smithi067.stdout:{"cluster_fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","whoami":0,"id":4323,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.856252776,"mdsmap_epoch":7,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":21.145733695000001} 2020-11-20T11:29:47.034 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6db90bc8-73b8-4163-bb1f-2d88eda44265", "fs_name": "cephfs", "id": 4323, "mdsmap_epoch": 7, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 14.856252776, "state": "up:active", "uptime": 21.145733695, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:29:47.034 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-11-20T11:29:47.055 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-11-20T11:29:47.055 INFO:tasks.ceph_fuse:config is None 2020-11-20T11:29:47.056 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-11-20T11:29:47.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.057 INFO:teuthology.orchestra.run.smithi105:> ip netns list 2020-11-20T11:29:47.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.073 INFO:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2020-11-20T11:29:47.141 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2020-11-20T11:29:47.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:29:47.143 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-11-20T11:29:47.143 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T11:29:47.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2020-11-20T11:29:47.144 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T11:29:47.144 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T11:29:47.145 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T11:29:47.145 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T11:29:47.145 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T11:29:47.146 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:29:47.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.146 INFO:teuthology.orchestra.run.smithi105:> ip addr 2020-11-20T11:29:47.197 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T11:29:47.197 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T11:29:47.198 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T11:29:47.198 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:29:47.198 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2020-11-20T11:29:47.198 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:29:47.198 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:29:47.199 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:29:47.199 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:29:47.199 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:29:47.199 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:29:47.200 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:29:47.200 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T11:29:47.200 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:29:47.200 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T11:29:47.200 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42765sec preferred_lft 42765sec 2020-11-20T11:29:47.201 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2020-11-20T11:29:47.201 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:29:47.201 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T11:29:47.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.202 INFO:teuthology.orchestra.run.smithi105:> (cd / && exec sudo bash -c ' 2020-11-20T11:29:47.202 INFO:teuthology.orchestra.run.smithi105:> set -e 2020-11-20T11:29:47.203 INFO:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2020-11-20T11:29:47.203 INFO:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2020-11-20T11:29:47.203 INFO:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2020-11-20T11:29:47.204 INFO:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T11:29:47.204 INFO:teuthology.orchestra.run.smithi105:> ') 2020-11-20T11:29:47.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.369 INFO:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T11:29:47.400 INFO:teuthology.orchestra.run.smithi105.stdout:1 2020-11-20T11:29:47.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.401 INFO:teuthology.orchestra.run.smithi105:> route 2020-11-20T11:29:47.488 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2020-11-20T11:29:47.488 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T11:29:47.488 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-11-20T11:29:47.488 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-11-20T11:29:47.489 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T11:29:47.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.490 INFO:teuthology.orchestra.run.smithi105:> (cd / && exec sudo bash -c ' 2020-11-20T11:29:47.490 INFO:teuthology.orchestra.run.smithi105:> set -e 2020-11-20T11:29:47.490 INFO:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T11:29:47.491 INFO:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T11:29:47.491 INFO:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T11:29:47.491 INFO:teuthology.orchestra.run.smithi105:> ') 2020-11-20T11:29:47.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.681 INFO:teuthology.orchestra.run.smithi105:> ip netns list 2020-11-20T11:29:47.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.696 INFO:teuthology.orchestra.run.smithi105:> ip netns list-id 2020-11-20T11:29:47.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.749 INFO:teuthology.orchestra.run.smithi105:> (cd / && exec sudo bash -c ' 2020-11-20T11:29:47.750 INFO:teuthology.orchestra.run.smithi105:> set -e 2020-11-20T11:29:47.750 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:29:47.750 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T11:29:47.751 INFO:teuthology.orchestra.run.smithi105:> ') 2020-11-20T11:29:47.846 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T11:29:47.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:47.847 INFO:teuthology.orchestra.run.smithi105:> (cd / && exec sudo bash -c ' 2020-11-20T11:29:47.847 INFO:teuthology.orchestra.run.smithi105:> set -e 2020-11-20T11:29:47.848 INFO:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T11:29:47.848 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T11:29:47.848 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T11:29:47.848 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T11:29:47.849 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T11:29:47.849 INFO:teuthology.orchestra.run.smithi105:> ') 2020-11-20T11:29:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:29:48.044 INFO:teuthology.orchestra.run.smithi105:> (cd / && exec sudo bash -c ' 2020-11-20T11:29:48.044 INFO:teuthology.orchestra.run.smithi105:> set -e 2020-11-20T11:29:48.044 INFO:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2020-11-20T11:29:48.045 INFO:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T11:29:48.045 INFO:teuthology.orchestra.run.smithi105:> ') 2020-11-20T11:29:48.146 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:29:48.267 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.264+0000 7f29f56b3700 1 Processor -- start 2020-11-20T11:29:48.268 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.264+0000 7f29f56b3700 1 -- start start 2020-11-20T11:29:48.270 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29f56b3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29f014b390 0x7f29f014df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.270 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29f56b3700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f00bfc10 con 0x7f29f014b770 2020-11-20T11:29:48.270 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29f56b3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f014e6e0 con 0x7f29f00bdda0 2020-11-20T11:29:48.270 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29f56b3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f014eec0 con 0x7f29f014b390 2020-11-20T11:29:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29ef7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f29f00bdda0 0x7f29f0062780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41734/0 (socket says 172.21.15.105:41734) 2020-11-20T11:29:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29ef7fe700 1 -- 172.21.15.105:0/2557835310 learned_addr learned my addr 172.21.15.105:0/2557835310 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2557835310 >> v2:172.21.15.67:3300/0 conn(0x7f29f014b390 0x7f29f014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29edffb700 1 -- 172.21.15.105:0/2557835310 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979874911 0 0) 0x7f29f014e6e0 con 0x7f29f00bdda0 2020-11-20T11:29:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29edffb700 1 -- 172.21.15.105:0/2557835310 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d0003240 con 0x7f29f00bdda0 2020-11-20T11:29:48.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29eeffd700 1 -- 172.21.15.105:0/2557835310 >> v1:172.21.15.105:6789/0 conn(0x7f29f00bdda0 legacy=0x7f29f0062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29eeffd700 1 -- 172.21.15.105:0/2557835310 >> v1:172.21.15.100:6789/0 conn(0x7f29f014b770 legacy=0x7f29f00c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29eeffd700 1 -- 172.21.15.105:0/2557835310 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f014e980 con 0x7f29f014b390 2020-11-20T11:29:48.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.265+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2557835310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b390 0x7f29f014df20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f29e8009c90 tx=0x7f29e80091d0).ready entity=mon.0 client_cookie=c6bd32efc3c4a413 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.272 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29edffb700 1 -- 172.21.15.105:0/2557835310 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800ba70 con 0x7f29f014b390 2020-11-20T11:29:48.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29edffb700 1 -- 172.21.15.105:0/2557835310 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800bbd0 con 0x7f29f014b390 2020-11-20T11:29:48.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29edffb700 1 -- 172.21.15.105:0/2557835310 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011400 con 0x7f29f014b390 2020-11-20T11:29:48.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 -- 172.21.15.105:0/2557835310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b390 msgr2=0x7f29f014df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.273 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2557835310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b390 0x7f29f014df20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f29e8009c90 tx=0x7f29e80091d0).stop 2020-11-20T11:29:48.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 -- 172.21.15.105:0/2557835310 shutdown_connections 2020-11-20T11:29:48.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2557835310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b390 0x7f29f014df20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 -- 172.21.15.105:0/2557835310 >> 172.21.15.105:0/2557835310 conn(0x7f29f00b9910 msgr2=0x7f29f00b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:48.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 -- 172.21.15.105:0/2557835310 shutdown_connections 2020-11-20T11:29:48.274 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.266+0000 7f29f56b3700 1 -- 172.21.15.105:0/2557835310 wait complete. 2020-11-20T11:29:48.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.267+0000 7f29f56b3700 1 Processor -- start 2020-11-20T11:29:48.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.267+0000 7f29f56b3700 1 -- start start 2020-11-20T11:29:48.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 0x7f29f0160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 0x7f29f009b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f00c0b90 con 0x7f29f014b770 2020-11-20T11:29:48.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0149390 con 0x7f29f00bdda0 2020-11-20T11:29:48.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29f56b3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f014d690 con 0x7f29f014b390 2020-11-20T11:29:48.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ee7fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ee7fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42136/0 (socket says 172.21.15.105:42136) 2020-11-20T11:29:48.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ee7fc700 1 -- 172.21.15.105:0/2673929480 learned_addr learned my addr 172.21.15.105:0/2673929480 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:48.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ef7fe700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 0x7f29f009b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 0x7f29f0160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ee7fc700 1 -- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 msgr2=0x7f29f0160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.268+0000 7f29ee7fc700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 0x7f29f0160450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29ee7fc700 1 -- 172.21.15.105:0/2673929480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 msgr2=0x7f29f009b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29ee7fc700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 0x7f29f009b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29ee7fc700 1 -- 172.21.15.105:0/2673929480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f014c3c0 con 0x7f29f014b390 2020-11-20T11:29:48.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 0x7f29f0160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:48.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29ef7fe700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 0x7f29f009b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:48.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29ee7fc700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f29d800c710 tx=0x7f29d8007c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800e560 con 0x7f29f014b390 2020-11-20T11:29:48.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d800e6c0 con 0x7f29f014b390 2020-11-20T11:29:48.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f014d8f0 con 0x7f29f014b390 2020-11-20T11:29:48.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800ea40 con 0x7f29f014b390 2020-11-20T11:29:48.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.269+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f014de30 con 0x7f29f014b390 2020-11-20T11:29:48.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.270+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0044f60 con 0x7f29f014b390 2020-11-20T11:29:48.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.270+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f29d8010030 con 0x7f29f014b390 2020-11-20T11:29:48.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.271+0000 7f29e6ffd700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 0x7f29cc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.271+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f29d80a2890 con 0x7f29f014b390 2020-11-20T11:29:48.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.271+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 0x7f29cc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.283 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.271+0000 7f29eeffd700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 0x7f29cc082af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f29e800b770 tx=0x7f29e8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.284 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.274+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f29d80772a0 con 0x7f29f014b390 2020-11-20T11:29:48.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.439+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29f014c060 con 0x7f29f014b390 2020-11-20T11:29:48.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.440+0000 7f29e6ffd700 1 -- 172.21.15.105:0/2673929480 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f29d800edb0 con 0x7f29f014b390 2020-11-20T11:29:48.443 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:48.444 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:29:48.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 msgr2=0x7f29cc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 0x7f29cc082af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f29e800b770 tx=0x7f29e8016000).stop 2020-11-20T11:29:48.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 msgr2=0x7f29f014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.446 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f29d800c710 tx=0x7f29d8007c00).stop 2020-11-20T11:29:48.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 shutdown_connections 2020-11-20T11:29:48.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f014b770 0x7f29f009b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f00bdda0 0x7f29f0160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f29cc080630 0x7f29cc082af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.447 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 --2- 172.21.15.105:0/2673929480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29f014b390 0x7f29f014bb70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 >> 172.21.15.105:0/2673929480 conn(0x7f29f00b9910 msgr2=0x7f29f0143310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:48.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 shutdown_connections 2020-11-20T11:29:48.448 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.441+0000 7f29f56b3700 1 -- 172.21.15.105:0/2673929480 wait complete. 2020-11-20T11:29:48.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:29:11.234336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:29:24.196669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:29:27.352951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:29:29.818965+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:29:48.457 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:29:48.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.573+0000 7f782afa2700 1 Processor -- start 2020-11-20T11:29:48.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.573+0000 7f782afa2700 1 -- start start 2020-11-20T11:29:48.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782afa2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78240bdd90 0x7f782414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782afa2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782409b250 con 0x7f78240bf4d0 2020-11-20T11:29:48.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782afa2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782414f5a0 con 0x7f78240c34c0 2020-11-20T11:29:48.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782afa2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782414f840 con 0x7f78240bdd90 2020-11-20T11:29:48.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f7828d3e700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f78240c34c0 0x7f78240bedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41746/0 (socket says 172.21.15.105:41746) 2020-11-20T11:29:48.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f7828d3e700 1 -- 172.21.15.105:0/21779017 learned_addr learned my addr 172.21.15.105:0/21779017 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:48.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782953f700 1 --2- 172.21.15.105:0/21779017 >> v2:172.21.15.105:3300/0 conn(0x7f78240bdd90 0x7f782414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f78237fe700 1 -- 172.21.15.105:0/21779017 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147041994 0 0) 0x7f782414f5a0 con 0x7f78240c34c0 2020-11-20T11:29:48.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f78237fe700 1 -- 172.21.15.105:0/21779017 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7810003240 con 0x7f78240c34c0 2020-11-20T11:29:48.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782953f700 1 -- 172.21.15.105:0/21779017 >> v1:172.21.15.105:6789/0 conn(0x7f78240c34c0 legacy=0x7f78240bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782953f700 1 -- 172.21.15.105:0/21779017 >> v1:172.21.15.67:6789/0 conn(0x7f78240bf4d0 legacy=0x7f78240bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782953f700 1 -- 172.21.15.105:0/21779017 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782414fae0 con 0x7f78240bdd90 2020-11-20T11:29:48.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f782953f700 1 --2- 172.21.15.105:0/21779017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bdd90 0x7f782414eff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f781c009c90 tx=0x7f781c0091d0).ready entity=mon.2 client_cookie=3c6ab67a923a71d4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f78237fe700 1 -- 172.21.15.105:0/21779017 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00bb00 con 0x7f78240bdd90 2020-11-20T11:29:48.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f78237fe700 1 -- 172.21.15.105:0/21779017 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00bc60 con 0x7f78240bdd90 2020-11-20T11:29:48.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.574+0000 7f78237fe700 1 -- 172.21.15.105:0/21779017 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c011400 con 0x7f78240bdd90 2020-11-20T11:29:48.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 -- 172.21.15.105:0/21779017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bdd90 msgr2=0x7f782414eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 --2- 172.21.15.105:0/21779017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bdd90 0x7f782414eff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f781c009c90 tx=0x7f781c0091d0).stop 2020-11-20T11:29:48.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 -- 172.21.15.105:0/21779017 shutdown_connections 2020-11-20T11:29:48.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 --2- 172.21.15.105:0/21779017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bdd90 0x7f782414eff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 -- 172.21.15.105:0/21779017 >> 172.21.15.105:0/21779017 conn(0x7f78240b9890 msgr2=0x7f78240b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:48.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 -- 172.21.15.105:0/21779017 shutdown_connections 2020-11-20T11:29:48.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.575+0000 7f782afa2700 1 -- 172.21.15.105:0/21779017 wait complete. 2020-11-20T11:29:48.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.576+0000 7f782afa2700 1 Processor -- start 2020-11-20T11:29:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.576+0000 7f782afa2700 1 -- start start 2020-11-20T11:29:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78240bdd90 0x7f782408ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78240c34c0 0x7f7824149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782415e170 con 0x7f78240bdd90 2020-11-20T11:29:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78241621d0 con 0x7f78240c34c0 2020-11-20T11:29:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782afa2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7824162470 con 0x7f78240bf4d0 2020-11-20T11:29:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42150/0 (socket says 172.21.15.105:42150) 2020-11-20T11:29:48.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 -- 172.21.15.105:0/562428859 learned_addr learned my addr 172.21.15.105:0/562428859 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:48.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7828d3e700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78240bdd90 0x7f782408ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f782953f700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78240c34c0 0x7f7824149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 -- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78240c34c0 msgr2=0x7f7824149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78240c34c0 0x7f7824149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 -- 172.21.15.105:0/562428859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78240bdd90 msgr2=0x7f782408ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78240bdd90 0x7f782408ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 -- 172.21.15.105:0/562428859 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782415e3b0 con 0x7f78240bf4d0 2020-11-20T11:29:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.577+0000 7f7823fff700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f781800c710 tx=0x7f7818007ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.578+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800e560 con 0x7f78240bf4d0 2020-11-20T11:29:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.578+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800e6c0 con 0x7f78240bf4d0 2020-11-20T11:29:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.578+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ea60 con 0x7f78240bf4d0 2020-11-20T11:29:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.578+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782415e650 con 0x7f78240bf4d0 2020-11-20T11:29:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.578+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782409a820 con 0x7f78240bf4d0 2020-11-20T11:29:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.579+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782415eab0 con 0x7f78240bf4d0 2020-11-20T11:29:48.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.579+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7818010030 con 0x7f78240bf4d0 2020-11-20T11:29:48.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.579+0000 7f7820ff9700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 0x7f77fc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.580+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f78180a28b0 con 0x7f78240bf4d0 2020-11-20T11:29:48.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.580+0000 7f7828d3e700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 0x7f77fc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.580+0000 7f7828d3e700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 0x7f77fc082af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f78140055a0 tx=0x7f7814009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.583+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f78180772c0 con 0x7f78240bf4d0 2020-11-20T11:29:48.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.747+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7824044f60 con 0x7f78240bf4d0 2020-11-20T11:29:48.751 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.748+0000 7f7820ff9700 1 -- 172.21.15.105:0/562428859 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f781807a8e0 con 0x7f78240bf4d0 2020-11-20T11:29:48.752 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2020-11-20T11:29:48.754 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 msgr2=0x7f77fc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.754 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 0x7f77fc082af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f78140055a0 tx=0x7f7814009040).stop 2020-11-20T11:29:48.754 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 msgr2=0x7f7824153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.754 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f781800c710 tx=0x7f7818007ba0).stop 2020-11-20T11:29:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 shutdown_connections 2020-11-20T11:29:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78240c34c0 0x7f7824149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78240bdd90 0x7f782408ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f77fc080630 0x7f77fc082af0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 --2- 172.21.15.105:0/562428859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78240bf4d0 0x7f7824153010 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 >> 172.21.15.105:0/562428859 conn(0x7f78240b9890 msgr2=0x7f782414bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:48.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 shutdown_connections 2020-11-20T11:29:48.756 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.750+0000 7f782afa2700 1 -- 172.21.15.105:0/562428859 wait complete. 2020-11-20T11:29:48.765 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:29:48.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.883+0000 7fc9b5c06700 1 Processor -- start 2020-11-20T11:29:48.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.883+0000 7fc9b5c06700 1 -- start start 2020-11-20T11:29:48.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9b5c06700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9b009ad30 0x7fc9b00c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9b5c06700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b00bde30 con 0x7fc9b00c37f0 2020-11-20T11:29:48.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9b5c06700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b014de60 con 0x7fc9b014b410 2020-11-20T11:29:48.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9b5c06700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b00beae0 con 0x7fc9b009ad30 2020-11-20T11:29:48.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9af7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc9b014b410 0x7fc9b0065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41760/0 (socket says 172.21.15.105:41760) 2020-11-20T11:29:48.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9af7fe700 1 -- 172.21.15.105:0/585792929 learned_addr learned my addr 172.21.15.105:0/585792929 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:48.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/585792929 >> v2:172.21.15.67:3300/0 conn(0x7fc9b009ad30 0x7fc9b00c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693442937 0 0) 0x7fc9a00010d0 con 0x7fc9b014b410 2020-11-20T11:29:48.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc990003240 con 0x7fc9b014b410 2020-11-20T11:29:48.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9aeffd700 1 -- 172.21.15.105:0/585792929 >> v1:172.21.15.105:6789/0 conn(0x7fc9b014b410 legacy=0x7fc9b0065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.884+0000 7fc9aeffd700 1 -- 172.21.15.105:0/585792929 >> v1:172.21.15.67:6789/0 conn(0x7fc9b00c37f0 legacy=0x7fc9b014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724581271 0 0) 0x7fc9b00bde30 con 0x7fc9b00c37f0 2020-11-20T11:29:48.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9aeffd700 1 -- 172.21.15.105:0/585792929 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00be060 con 0x7fc9b009ad30 2020-11-20T11:29:48.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/585792929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b009ad30 0x7fc9b00c3300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc99800b990 tx=0x7fc998006d90).ready entity=mon.0 client_cookie=39bfa091c08fdebd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998006030 con 0x7fc9b009ad30 2020-11-20T11:29:48.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998006190 con 0x7fc9b009ad30 2020-11-20T11:29:48.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9ae7fc700 1 -- 172.21.15.105:0/585792929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998006510 con 0x7fc9b009ad30 2020-11-20T11:29:48.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 -- 172.21.15.105:0/585792929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b009ad30 msgr2=0x7fc9b00c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/585792929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b009ad30 0x7fc9b00c3300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc99800b990 tx=0x7fc998006d90).stop 2020-11-20T11:29:48.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 -- 172.21.15.105:0/585792929 shutdown_connections 2020-11-20T11:29:48.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/585792929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b009ad30 0x7fc9b00c3300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 -- 172.21.15.105:0/585792929 >> 172.21.15.105:0/585792929 conn(0x7fc9b00b9890 msgr2=0x7fc9b00b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:48.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 -- 172.21.15.105:0/585792929 shutdown_connections 2020-11-20T11:29:48.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.885+0000 7fc9b5c06700 1 -- 172.21.15.105:0/585792929 wait complete. 2020-11-20T11:29:48.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.886+0000 7fc9b5c06700 1 Processor -- start 2020-11-20T11:29:48.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 -- start start 2020-11-20T11:29:48.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 0x7fc9b00bb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 0x7fc9b014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0164bb0 con 0x7fc9b00c37f0 2020-11-20T11:29:48.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0160900 con 0x7fc9b014b410 2020-11-20T11:29:48.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9b5c06700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0160ba0 con 0x7fc9b009ad30 2020-11-20T11:29:48.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42160/0 (socket says 172.21.15.105:42160) 2020-11-20T11:29:48.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.887+0000 7fc9af7fe700 1 -- 172.21.15.105:0/693605638 learned_addr learned my addr 172.21.15.105:0/693605638 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:48.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9affff700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 0x7fc9b014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 0x7fc9b00bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 -- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 msgr2=0x7fc9b014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 0x7fc9b014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 -- 172.21.15.105:0/693605638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 msgr2=0x7fc9b00bb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:48.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 0x7fc9b00bb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:48.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 -- 172.21.15.105:0/693605638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0160e40 con 0x7fc9b009ad30 2020-11-20T11:29:48.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9affff700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 0x7fc9b014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:48.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 0x7fc9b00bb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:48.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9af7fe700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc9a000c710 tx=0x7fc9a0007940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0007320 con 0x7fc9b009ad30 2020-11-20T11:29:48.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a0007480 con 0x7fc9b009ad30 2020-11-20T11:29:48.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b01610e0 con 0x7fc9b009ad30 2020-11-20T11:29:48.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005800 con 0x7fc9b009ad30 2020-11-20T11:29:48.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.888+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b0161620 con 0x7fc9b009ad30 2020-11-20T11:29:48.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.889+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b00c2310 con 0x7fc9b009ad30 2020-11-20T11:29:48.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.890+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc9a0010030 con 0x7fc9b009ad30 2020-11-20T11:29:48.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.891+0000 7fc98f7fe700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 0x7fc988082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:48.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.891+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc9a00a2aa0 con 0x7fc9b009ad30 2020-11-20T11:29:48.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.891+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 0x7fc988082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:48.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.891+0000 7fc9aeffd700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 0x7fc988082b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc99800b990 tx=0x7fc998015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:48.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:48.894+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc9a0077450 con 0x7fc9b009ad30 2020-11-20T11:29:49.060 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.056+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9b014de60 con 0x7fc9b009ad30 2020-11-20T11:29:49.060 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.057+0000 7fc98f7fe700 1 -- 172.21.15.105:0/693605638 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9b014de60 con 0x7fc9b009ad30 2020-11-20T11:29:49.061 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:49.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 msgr2=0x7fc988082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 0x7fc988082b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc99800b990 tx=0x7fc998015000).stop 2020-11-20T11:29:49.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 msgr2=0x7fc9b01646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc9a000c710 tx=0x7fc9a0007940).stop 2020-11-20T11:29:49.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 shutdown_connections 2020-11-20T11:29:49.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9b014b410 0x7fc9b014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc988080660 0x7fc988082b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9b009ad30 0x7fc9b01646c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.064 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 --2- 172.21.15.105:0/693605638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b00c37f0 0x7fc9b00bb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.064 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 >> 172.21.15.105:0/693605638 conn(0x7fc9b00b9890 msgr2=0x7fc9b0147650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.064 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 shutdown_connections 2020-11-20T11:29:49.064 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.058+0000 7fc9b5c06700 1 -- 172.21.15.105:0/693605638 wait complete. 2020-11-20T11:29:49.073 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:29:49.192 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.189+0000 7fd2ecd79700 1 Processor -- start 2020-11-20T11:29:49.193 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.189+0000 7fd2ecd79700 1 -- start start 2020-11-20T11:29:49.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2ecd79700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2e80c34c0 0x7fd2e814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2ecd79700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e809b250 con 0x7fd2e80bdd90 2020-11-20T11:29:49.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2ecd79700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e814f5a0 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.199 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2ecd79700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e814f840 con 0x7fd2e80c34c0 2020-11-20T11:29:49.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e6d9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd2e80bf4d0 0x7fd2e80bfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41772/0 (socket says 172.21.15.105:41772) 2020-11-20T11:29:49.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e6d9d700 1 -- 172.21.15.105:0/1423520525 learned_addr learned my addr 172.21.15.105:0/1423520525 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:49.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e659c700 1 --2- 172.21.15.105:0/1423520525 >> v2:172.21.15.67:3300/0 conn(0x7fd2e80c34c0 0x7fd2e814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.200 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449291305 0 0) 0x7fd2e814f5a0 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2cc003240 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721080062 0 0) 0x7fd2e809b250 con 0x7fd2e80bdd90 2020-11-20T11:29:49.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e814f5a0 con 0x7fd2e80bdd90 2020-11-20T11:29:49.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 201168521 0 0) 0x7fd2cc003240 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.201 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 >> v2:172.21.15.67:3300/0 conn(0x7fd2e80c34c0 msgr2=0x7fd2e814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:49.202 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 --2- 172.21.15.105:0/1423520525 >> v2:172.21.15.67:3300/0 conn(0x7fd2e80c34c0 0x7fd2e814eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.202 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 >> v1:172.21.15.100:6789/0 conn(0x7fd2e80bdd90 legacy=0x7fd2e80bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.202 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.190+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e814fae0 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.202 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fd2e0001860 con 0x7fd2e80bf4d0 2020-11-20T11:29:49.203 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 >> v1:172.21.15.105:6789/0 conn(0x7fd2e80bf4d0 legacy=0x7fd2e80bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.203 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2cc003910 0x7fd2cc003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.203 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2cc0044e0 0x7fd2cc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.203 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2cc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e814f840 con 0x7fd2cc003910 2020-11-20T11:29:49.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00bc20 con 0x7fd2cc0044e0 2020-11-20T11:29:49.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00bd60 con 0x7fd2cc004e50 2020-11-20T11:29:49.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2cc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e659c700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2cc003910 0x7fd2cc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.205 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e5d9b700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2cc0044e0 0x7fd2cc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.205 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 -- 172.21.15.105:0/1423520525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2cc0044e0 msgr2=0x7fd2cc004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:49.205 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2cc0044e0 0x7fd2cc004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.205 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 -- 172.21.15.105:0/1423520525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2cc003910 msgr2=0x7fd2cc003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:49.206 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2cc003910 0x7fd2cc003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.206 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 -- 172.21.15.105:0/1423520525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc003240 con 0x7fd2cc004e50 2020-11-20T11:29:49.206 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 -- 172.21.15.105:0/1423520525 reap_dead start 2020-11-20T11:29:49.206 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e6d9d700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2cc00b730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd2e000c600 tx=0x7fd2e814fc70).ready entity=mon.2 client_cookie=96f0020a726e5ce7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0005b80 con 0x7fd2cc004e50 2020-11-20T11:29:49.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0005ce0 con 0x7fd2cc004e50 2020-11-20T11:29:49.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.191+0000 7fd2e559a700 1 -- 172.21.15.105:0/1423520525 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00072e0 con 0x7fd2cc004e50 2020-11-20T11:29:49.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 -- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 msgr2=0x7fd2cc00b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.208 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2cc00b730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd2e000c600 tx=0x7fd2e814fc70).stop 2020-11-20T11:29:49.208 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 -- 172.21.15.105:0/1423520525 shutdown_connections 2020-11-20T11:29:49.208 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/1423520525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2cc00b730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.208 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 -- 172.21.15.105:0/1423520525 >> 172.21.15.105:0/1423520525 conn(0x7fd2e80b9890 msgr2=0x7fd2e80b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.208 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 -- 172.21.15.105:0/1423520525 shutdown_connections 2020-11-20T11:29:49.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.192+0000 7fd2ecd79700 1 -- 172.21.15.105:0/1423520525 wait complete. 2020-11-20T11:29:49.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.193+0000 7fd2ecd79700 1 Processor -- start 2020-11-20T11:29:49.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.193+0000 7fd2ecd79700 1 -- start start 2020-11-20T11:29:49.209 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 0x7fd2e815e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e814eb40 0x7fd2e815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815ea10 con 0x7fd2e814e6e0 2020-11-20T11:29:49.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8094310 con 0x7fd2e814eb40 2020-11-20T11:29:49.210 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8065f80 con 0x7fd2cc004e50 2020-11-20T11:29:49.211 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.211 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42178/0 (socket says 172.21.15.105:42178) 2020-11-20T11:29:49.211 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 -- 172.21.15.105:0/3456993449 learned_addr learned my addr 172.21.15.105:0/3456993449 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:49.211 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e6d9d700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e814eb40 0x7fd2e815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.211 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e5d9b700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 0x7fd2e815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.212 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 -- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e814eb40 msgr2=0x7fd2e815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.212 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e814eb40 0x7fd2e815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.212 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 -- 172.21.15.105:0/3456993449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 msgr2=0x7fd2e815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.212 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 0x7fd2e815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.213 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 -- 172.21.15.105:0/3456993449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8161710 con 0x7fd2cc004e50 2020-11-20T11:29:49.213 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e5d9b700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 0x7fd2e815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:49.213 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2e659c700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2dc006860 tx=0x7fd2dc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.213 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc018070 con 0x7fd2cc004e50 2020-11-20T11:29:49.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc00fa90 con 0x7fd2cc004e50 2020-11-20T11:29:49.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e8065ce0 con 0x7fd2cc004e50 2020-11-20T11:29:49.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00fe10 con 0x7fd2cc004e50 2020-11-20T11:29:49.214 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.194+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8161c10 con 0x7fd2cc004e50 2020-11-20T11:29:49.215 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.195+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8044f60 con 0x7fd2cc004e50 2020-11-20T11:29:49.216 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.196+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd2dc014650 con 0x7fd2cc004e50 2020-11-20T11:29:49.216 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.196+0000 7fd2d67fc700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 0x7fd2bc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.216 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.197+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd2dc0a32d0 con 0x7fd2cc004e50 2020-11-20T11:29:49.216 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.197+0000 7fd2e5d9b700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 0x7fd2bc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.217 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.197+0000 7fd2e5d9b700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 0x7fd2bc082af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd2d80079c0 tx=0x7fd2d8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.217 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.200+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd2dc077c60 con 0x7fd2cc004e50 2020-11-20T11:29:49.367 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.364+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2e8061830 con 0x7fd2cc004e50 2020-11-20T11:29:49.367 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.364+0000 7fd2d67fc700 1 -- 172.21.15.105:0/3456993449 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd2dc07b280 con 0x7fd2cc004e50 2020-11-20T11:29:49.368 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:49.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 msgr2=0x7fd2bc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 0x7fd2bc082af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd2d80079c0 tx=0x7fd2d8009040).stop 2020-11-20T11:29:49.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 msgr2=0x7fd2e8093e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2dc006860 tx=0x7fd2dc006df0).stop 2020-11-20T11:29:49.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 shutdown_connections 2020-11-20T11:29:49.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e814eb40 0x7fd2e815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.365+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd2bc080630 0x7fd2bc082af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.366+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc004e50 0x7fd2e8093e20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.366+0000 7fd2ecd79700 1 --2- 172.21.15.105:0/3456993449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e814e6e0 0x7fd2e815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.366+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 >> 172.21.15.105:0/3456993449 conn(0x7fd2e80b9890 msgr2=0x7fd2e8062550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.366+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 shutdown_connections 2020-11-20T11:29:49.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.366+0000 7fd2ecd79700 1 -- 172.21.15.105:0/3456993449 wait complete. 2020-11-20T11:29:49.380 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:29:49.500 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.496+0000 7f7cf7894700 1 Processor -- start 2020-11-20T11:29:49.500 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.496+0000 7f7cf7894700 1 -- start start 2020-11-20T11:29:49.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf7894700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7cf009ad30 0x7f7cf00c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf7894700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf00bde30 con 0x7f7cf014b410 2020-11-20T11:29:49.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf7894700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf014de60 con 0x7f7cf00c37f0 2020-11-20T11:29:49.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf7894700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf00beae0 con 0x7f7cf009ad30 2020-11-20T11:29:49.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf4e2f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7cf009ad30 0x7f7cf00c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf5e31700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7cf00c37f0 0x7f7cf014e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41790/0 (socket says 172.21.15.105:41790) 2020-11-20T11:29:49.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.497+0000 7f7cf5e31700 1 -- 172.21.15.105:0/17724207 learned_addr learned my addr 172.21.15.105:0/17724207 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:49.504 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf4e2f700 1 -- 172.21.15.105:0/17724207 >> v1:172.21.15.105:6789/0 conn(0x7f7cf00c37f0 legacy=0x7f7cf014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.504 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf4e2f700 1 -- 172.21.15.105:0/17724207 >> v1:172.21.15.67:6789/0 conn(0x7f7cf014b410 legacy=0x7f7cf0065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.504 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cdffff700 1 -- 172.21.15.105:0/17724207 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585917029 0 0) 0x7f7ce8001450 con 0x7f7cf00c37f0 2020-11-20T11:29:49.504 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf4e2f700 1 -- 172.21.15.105:0/17724207 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00be060 con 0x7f7cf009ad30 2020-11-20T11:29:49.504 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf4e2f700 1 --2- 172.21.15.105:0/17724207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf009ad30 0x7f7cf00c3300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7cec00b990 tx=0x7f7cec006d90).ready entity=mon.2 client_cookie=9bcb04686bf32b0e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cdffff700 1 -- 172.21.15.105:0/17724207 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec006030 con 0x7f7cf009ad30 2020-11-20T11:29:49.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cdffff700 1 -- 172.21.15.105:0/17724207 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec006190 con 0x7f7cf009ad30 2020-11-20T11:29:49.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cdffff700 1 -- 172.21.15.105:0/17724207 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec006510 con 0x7f7cf009ad30 2020-11-20T11:29:49.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 -- 172.21.15.105:0/17724207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf009ad30 msgr2=0x7f7cf00c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 --2- 172.21.15.105:0/17724207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf009ad30 0x7f7cf00c3300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7cec00b990 tx=0x7f7cec006d90).stop 2020-11-20T11:29:49.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 -- 172.21.15.105:0/17724207 shutdown_connections 2020-11-20T11:29:49.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 --2- 172.21.15.105:0/17724207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf009ad30 0x7f7cf00c3300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 -- 172.21.15.105:0/17724207 >> 172.21.15.105:0/17724207 conn(0x7f7cf00b9890 msgr2=0x7f7cf00b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.498+0000 7f7cf7894700 1 -- 172.21.15.105:0/17724207 shutdown_connections 2020-11-20T11:29:49.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.499+0000 7f7cf7894700 1 -- 172.21.15.105:0/17724207 wait complete. 2020-11-20T11:29:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 Processor -- start 2020-11-20T11:29:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 -- start start 2020-11-20T11:29:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf009ad30 0x7f7cf01460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 0x7f7cf01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01465b0 con 0x7f7cf009ad30 2020-11-20T11:29:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf014f240 con 0x7f7cf00c37f0 2020-11-20T11:29:49.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf7894700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0061ea0 con 0x7f7cf014b410 2020-11-20T11:29:49.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.500+0000 7f7cf5e31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42194/0 (socket says 172.21.15.105:42194) 2020-11-20T11:29:49.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 -- 172.21.15.105:0/2974868611 learned_addr learned my addr 172.21.15.105:0/2974868611 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:49.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5630700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf009ad30 0x7f7cf01460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf4e2f700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 0x7f7cf01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 -- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 msgr2=0x7f7cf01511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 0x7f7cf01511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 -- 172.21.15.105:0/2974868611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf009ad30 msgr2=0x7f7cf01460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf009ad30 0x7f7cf01460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 -- 172.21.15.105:0/2974868611 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0062140 con 0x7f7cf014b410 2020-11-20T11:29:49.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf4e2f700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 0x7f7cf01511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:29:49.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf5e31700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7ce800ca60 tx=0x7f7ce8007be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.514 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8005b80 con 0x7f7cf014b410 2020-11-20T11:29:49.514 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8005ce0 con 0x7f7cf014b410 2020-11-20T11:29:49.514 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8007320 con 0x7f7cf014b410 2020-11-20T11:29:49.514 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf00623e0 con 0x7f7cf014b410 2020-11-20T11:29:49.514 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.501+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf0149260 con 0x7f7cf014b410 2020-11-20T11:29:49.515 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.502+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf014ef70 con 0x7f7cf014b410 2020-11-20T11:29:49.515 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.503+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7ce8010030 con 0x7f7cf014b410 2020-11-20T11:29:49.515 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.503+0000 7f7cdd7fa700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 0x7f7cc8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.515 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.503+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7ce80a26e0 con 0x7f7cf014b410 2020-11-20T11:29:49.515 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.503+0000 7f7cf5630700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 0x7f7cc8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.516 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.504+0000 7f7cf5630700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 0x7f7cc8082af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7ce0000bc0 tx=0x7f7ce0007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.516 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.506+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7ce80770f0 con 0x7f7cf014b410 2020-11-20T11:29:49.672 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.668+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cf014de60 con 0x7f7cf014b410 2020-11-20T11:29:49.672 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.669+0000 7f7cdd7fa700 1 -- 172.21.15.105:0/2974868611 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7cf014de60 con 0x7f7cf014b410 2020-11-20T11:29:49.673 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 8 2020-11-20T11:29:49.674 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 msgr2=0x7f7cc8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.674 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 0x7f7cc8082af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7ce0000bc0 tx=0x7f7ce0007b70).stop 2020-11-20T11:29:49.674 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 msgr2=0x7f7cf014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.675 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7ce800ca60 tx=0x7f7ce8007be0).stop 2020-11-20T11:29:49.675 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 shutdown_connections 2020-11-20T11:29:49.675 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7cc8080630 0x7f7cc8082af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.675 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cf014b410 0x7f7cf014e380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.675 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf009ad30 0x7f7cf01460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 --2- 172.21.15.105:0/2974868611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf00c37f0 0x7f7cf01511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 >> 172.21.15.105:0/2974868611 conn(0x7f7cf00b9890 msgr2=0x7f7cf00c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 shutdown_connections 2020-11-20T11:29:49.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.670+0000 7f7cf7894700 1 -- 172.21.15.105:0/2974868611 wait complete. 2020-11-20T11:29:49.685 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T11:29:49.685 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:29:49.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.800+0000 7f7379958700 1 Processor -- start 2020-11-20T11:29:49.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.800+0000 7f7379958700 1 -- start start 2020-11-20T11:29:49.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7379958700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f737414b770 0x7f73740c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7379958700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f73740c0aa0 0x7f7374062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7379958700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740bfc10 con 0x7f737414b390 2020-11-20T11:29:49.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7379958700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737414eec0 con 0x7f73740c0aa0 2020-11-20T11:29:49.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7379958700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737414e6e0 con 0x7f737414b770 2020-11-20T11:29:49.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73727fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f737414b770 0x7f73740c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7372ffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f737414b390 0x7f737414df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41804/0 (socket says 172.21.15.105:41804) 2020-11-20T11:29:49.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f7372ffd700 1 -- 172.21.15.105:0/1603856657 learned_addr learned my addr 172.21.15.105:0/1603856657 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:29:49.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73737fe700 1 --2- 172.21.15.105:0/1603856657 >> v2:172.21.15.100:3300/0 conn(0x7f73740c0aa0 0x7f7374062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73727fc700 1 -- 172.21.15.105:0/1603856657 >> v2:172.21.15.100:3300/0 conn(0x7f73740c0aa0 msgr2=0x7f7374062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:29:49.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73727fc700 1 --2- 172.21.15.105:0/1603856657 >> v2:172.21.15.100:3300/0 conn(0x7f73740c0aa0 0x7f7374062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73727fc700 1 -- 172.21.15.105:0/1603856657 >> v1:172.21.15.105:6789/0 conn(0x7f737414b390 legacy=0x7f737414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.801+0000 7f73727fc700 1 -- 172.21.15.105:0/1603856657 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737414e980 con 0x7f737414b770 2020-11-20T11:29:49.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f73727fc700 1 --2- 172.21.15.105:0/1603856657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f737414b770 0x7f73740c05b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f73740648d0 tx=0x7f7364006df0).ready entity=mon.2 client_cookie=c9da4ec60f6d76c6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7371ffb700 1 -- 172.21.15.105:0/1603856657 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73640097b0 con 0x7f737414b770 2020-11-20T11:29:49.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7371ffb700 1 -- 172.21.15.105:0/1603856657 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364009910 con 0x7f737414b770 2020-11-20T11:29:49.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7371ffb700 1 -- 172.21.15.105:0/1603856657 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364009c90 con 0x7f737414b770 2020-11-20T11:29:49.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 -- 172.21.15.105:0/1603856657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f737414b770 msgr2=0x7f73740c05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 --2- 172.21.15.105:0/1603856657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f737414b770 0x7f73740c05b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f73740648d0 tx=0x7f7364006df0).stop 2020-11-20T11:29:49.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 -- 172.21.15.105:0/1603856657 shutdown_connections 2020-11-20T11:29:49.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 --2- 172.21.15.105:0/1603856657 >> v2:172.21.15.100:3300/0 conn(0x7f73740c0aa0 0x7f7374062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 --2- 172.21.15.105:0/1603856657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f737414b770 0x7f73740c05b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 -- 172.21.15.105:0/1603856657 >> 172.21.15.105:0/1603856657 conn(0x7f73740b9910 msgr2=0x7f73740b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:49.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 -- 172.21.15.105:0/1603856657 shutdown_connections 2020-11-20T11:29:49.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.802+0000 7f7379958700 1 -- 172.21.15.105:0/1603856657 wait complete. 2020-11-20T11:29:49.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.803+0000 7f7379958700 1 Processor -- start 2020-11-20T11:29:49.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 -- start start 2020-11-20T11:29:49.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 0x7f7374164a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737414b770 0x7f73740c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374160b70 con 0x7f737414b390 2020-11-20T11:29:49.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374164f10 con 0x7f737414b770 2020-11-20T11:29:49.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7379958700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374148bb0 con 0x7f73740c0aa0 2020-11-20T11:29:49.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7372ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7372ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42206/0 (socket says 172.21.15.105:42206) 2020-11-20T11:29:49.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.804+0000 7f7372ffd700 1 -- 172.21.15.105:0/3818003968 learned_addr learned my addr 172.21.15.105:0/3818003968 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:29:49.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f73727fc700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 0x7f7374164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f73737fe700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737414b770 0x7f73740c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 -- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737414b770 msgr2=0x7f73740c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737414b770 0x7f73740c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 -- 172.21.15.105:0/3818003968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 msgr2=0x7f7374164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:49.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 0x7f7374164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:49.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 -- 172.21.15.105:0/3818003968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737414a1d0 con 0x7f73740c0aa0 2020-11-20T11:29:49.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f73727fc700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 0x7f7374164a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:29:49.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7372ffd700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f736800c740 tx=0x7f7368007c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368007320 con 0x7f73740c0aa0 2020-11-20T11:29:49.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368007480 con 0x7f73740c0aa0 2020-11-20T11:29:49.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737414a470 con 0x7f73740c0aa0 2020-11-20T11:29:49.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368005800 con 0x7f73740c0aa0 2020-11-20T11:29:49.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.805+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7374161000 con 0x7f73740c0aa0 2020-11-20T11:29:49.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.806+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374044f60 con 0x7f73740c0aa0 2020-11-20T11:29:49.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.807+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7368010030 con 0x7f73740c0aa0 2020-11-20T11:29:49.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.807+0000 7f735affd700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 0x7f7350082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:29:49.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.807+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f73680a27a0 con 0x7f73740c0aa0 2020-11-20T11:29:49.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.807+0000 7f73727fc700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 0x7f7350082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:29:49.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.807+0000 7f73727fc700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 0x7f7350082af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f73740c1420 tx=0x7f7364015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:29:49.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:49.811+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7368077150 con 0x7f73740c0aa0 2020-11-20T11:29:50.033 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.029+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73740c30d0 con 0x7f73740c0aa0 2020-11-20T11:29:51.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.030+0000 7f735affd700 1 -- 172.21.15.105:0/3818003968 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f736807a770 con 0x7f73740c0aa0 2020-11-20T11:29:51.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 msgr2=0x7f7350082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 0x7f7350082af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f73740c1420 tx=0x7f7364015000).stop 2020-11-20T11:29:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 msgr2=0x7f7374161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:29:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f736800c740 tx=0x7f7368007c00).stop 2020-11-20T11:29:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 shutdown_connections 2020-11-20T11:29:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737414b770 0x7f73740c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:51.118 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7350080630 0x7f7350082af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:51.118 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740c0aa0 0x7f7374161740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:51.118 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 --2- 172.21.15.105:0/3818003968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f737414b390 0x7f7374164a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:29:51.118 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 >> 172.21.15.105:0/3818003968 conn(0x7f73740b9910 msgr2=0x7f7374066790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:29:51.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 shutdown_connections 2020-11-20T11:29:51.119 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:29:50.031+0000 7f7379958700 1 -- 172.21.15.105:0/3818003968 wait complete. 2020-11-20T11:29:51.119 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 7 2020-11-20T11:29:51.119 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:29:51.119 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.100:6835/2752212696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2752212696},{"type":"v1","addr":"172.21.15.100:6835","nonce":2752212696}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4295,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2514469097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2514469097},{"type":"v1","addr":"172.21.15.105:6833","nonce":2514469097}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:29:32.164149+0000","modified":"2020-11-20T11:29:34.808094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/151091778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":151091778},{"type":"v1","addr":"172.21.15.67:6833","nonce":151091778}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:29:51.422 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:29:32.164149+0000', 'modified': '2020-11-20T11:29:34.808094+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4323': {'gid': 4323, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6833/151091778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 151091778}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 151091778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:29:51.423 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:29:51.423 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-11-20T11:29:51.583 INFO:teuthology.orchestra.run.smithi067.stdout:{"cluster_fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","whoami":0,"id":4323,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":19.405746356000002,"mdsmap_epoch":7,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":25.695221783000001} 2020-11-20T11:29:51.583 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6db90bc8-73b8-4163-bb1f-2d88eda44265", "fs_name": "cephfs", "id": 4323, "mdsmap_epoch": 7, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 19.405746356, "state": "up:active", "uptime": 25.695221783, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:29:51.584 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-11-20T11:29:51.584 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-11-20T11:29:51.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:51.585 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:29:51.604 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:29:51.605 INFO:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2020-11-20T11:29:51.709 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:29:51.709 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:29:51.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:51.740 INFO:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2020-11-20T11:29:51.795 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-11-20T11:29:51.796 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --id 0 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:29:51.837 INFO:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2020-11-20T11:29:51.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:29:51.866 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:29:51.943 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-11-20T11:29:51.944 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T11:29:51.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:51.945 INFO:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2020-11-20T11:29:51.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi105.stderr:2020-11-20T11:29:51.940+0000 7f40086b0200 -1 init, newargv = 0x557f56a2a120 newargc=15 2020-11-20T11:29:51.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi105.stderr:ceph-fuse[30372]: starting ceph client 2020-11-20T11:29:51.949 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi105.stderr:ceph-fuse[30372]: starting fuse 2020-11-20T11:29:51.963 INFO:teuthology.orchestra.run.smithi105.stdout:47 2020-11-20T11:29:51.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-11-20T11:29:51.964 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-11-20T11:29:51.964 INFO:teuthology.orchestra.run.smithi105:> import glob 2020-11-20T11:29:51.965 INFO:teuthology.orchestra.run.smithi105:> import re 2020-11-20T11:29:51.965 INFO:teuthology.orchestra.run.smithi105:> import os 2020-11-20T11:29:51.965 INFO:teuthology.orchestra.run.smithi105:> import subprocess 2020-11-20T11:29:51.966 INFO:teuthology.orchestra.run.smithi105:> 2020-11-20T11:29:51.966 INFO:teuthology.orchestra.run.smithi105:> def _find_admin_socket(client_name): 2020-11-20T11:29:51.966 INFO:teuthology.orchestra.run.smithi105:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-11-20T11:29:51.967 INFO:teuthology.orchestra.run.smithi105:> files = glob.glob(asok_path) 2020-11-20T11:29:51.967 INFO:teuthology.orchestra.run.smithi105:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2020-11-20T11:29:51.967 INFO:teuthology.orchestra.run.smithi105:> 2020-11-20T11:29:51.968 INFO:teuthology.orchestra.run.smithi105:> # Given a non-glob path, it better be there 2020-11-20T11:29:51.968 INFO:teuthology.orchestra.run.smithi105:> if "*" not in asok_path: 2020-11-20T11:29:51.968 INFO:teuthology.orchestra.run.smithi105:> assert(len(files) == 1) 2020-11-20T11:29:51.969 INFO:teuthology.orchestra.run.smithi105:> return files[0] 2020-11-20T11:29:51.969 INFO:teuthology.orchestra.run.smithi105:> 2020-11-20T11:29:51.969 INFO:teuthology.orchestra.run.smithi105:> for f in files: 2020-11-20T11:29:51.970 INFO:teuthology.orchestra.run.smithi105:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-11-20T11:29:51.970 INFO:teuthology.orchestra.run.smithi105:> if os.path.exists("/proc/{0}".format(pid)): 2020-11-20T11:29:51.970 INFO:teuthology.orchestra.run.smithi105:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2020-11-20T11:29:51.971 INFO:teuthology.orchestra.run.smithi105:> contents = proc_f.read() 2020-11-20T11:29:51.971 INFO:teuthology.orchestra.run.smithi105:> if mountpoint in contents: 2020-11-20T11:29:51.971 INFO:teuthology.orchestra.run.smithi105:> return f 2020-11-20T11:29:51.972 INFO:teuthology.orchestra.run.smithi105:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-11-20T11:29:51.972 INFO:teuthology.orchestra.run.smithi105:> 2020-11-20T11:29:51.972 INFO:teuthology.orchestra.run.smithi105:> print(_find_admin_socket("client.0")) 2020-11-20T11:29:51.973 INFO:teuthology.orchestra.run.smithi105:> ' 2020-11-20T11:29:52.088 INFO:teuthology.orchestra.run.smithi105.stdout:/var/run/ceph/ceph-client.0.30372.asok 2020-11-20T11:29:52.270 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.30372.asok 2020-11-20T11:29:52.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:52.271 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.30372.asok status 2020-11-20T11:29:52.427 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:29:52.427 INFO:teuthology.orchestra.run.smithi105.stdout: "metadata": { 2020-11-20T11:29:52.427 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_sha1": "b86e691bf191566922a8f08e2a5abf64fde8cfcb", 2020-11-20T11:29:52.428 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 16.0.0-7397-gb86e691b (b86e691bf191566922a8f08e2a5abf64fde8cfcb) pacific (dev)", 2020-11-20T11:29:52.428 INFO:teuthology.orchestra.run.smithi105.stdout: "entity_id": "0", 2020-11-20T11:29:52.428 INFO:teuthology.orchestra.run.smithi105.stdout: "hostname": "smithi105", 2020-11-20T11:29:52.428 INFO:teuthology.orchestra.run.smithi105.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-11-20T11:29:52.428 INFO:teuthology.orchestra.run.smithi105.stdout: "pid": "30372", 2020-11-20T11:29:52.429 INFO:teuthology.orchestra.run.smithi105.stdout: "root": "/" 2020-11-20T11:29:52.429 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:29:52.429 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_count": 0, 2020-11-20T11:29:52.429 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_pinned_count": 0, 2020-11-20T11:29:52.429 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4661, 2020-11-20T11:29:52.430 INFO:teuthology.orchestra.run.smithi105.stdout: "inst": { 2020-11-20T11:29:52.430 INFO:teuthology.orchestra.run.smithi105.stdout: "name": { 2020-11-20T11:29:52.430 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2020-11-20T11:29:52.430 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4661 2020-11-20T11:29:52.430 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:29:52.431 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2020-11-20T11:29:52.431 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2020-11-20T11:29:52.431 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:29:52.431 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 4269063195 2020-11-20T11:29:52.432 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:29:52.432 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:29:52.432 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2020-11-20T11:29:52.432 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2020-11-20T11:29:52.432 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:29:52.433 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 4269063195 2020-11-20T11:29:52.433 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:29:52.433 INFO:teuthology.orchestra.run.smithi105.stdout: "inst_str": "client.4661 192.168.0.1:0/4269063195", 2020-11-20T11:29:52.433 INFO:teuthology.orchestra.run.smithi105.stdout: "addr_str": "192.168.0.1:0/4269063195", 2020-11-20T11:29:52.433 INFO:teuthology.orchestra.run.smithi105.stdout: "inode_count": 1, 2020-11-20T11:29:52.434 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_epoch": 7, 2020-11-20T11:29:52.434 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch": 28, 2020-11-20T11:29:52.434 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch_barrier": 0, 2020-11-20T11:29:52.434 INFO:teuthology.orchestra.run.smithi105.stdout: "blocklisted": false, 2020-11-20T11:29:52.434 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs" 2020-11-20T11:29:52.435 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:29:52.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:52.436 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-11-20T11:29:52.436 INFO:teuthology.orchestra.run.smithi105:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:29:52.454 INFO:teuthology.orchestra.run.smithi105.stdout:fuseblk 2020-11-20T11:29:52.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-11-20T11:29:52.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:29:52.455 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:29:52.532 INFO:teuthology.run_tasks:Running task check-counter... 2020-11-20T11:29:52.546 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T11:29:52.573 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:29:52.574 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T11:29:52.575 INFO:tasks.workunit:timeout=3h 2020-11-20T11:29:52.575 INFO:tasks.workunit:cleanup=True 2020-11-20T11:29:52.575 INFO:teuthology.orchestra.run.smithi105:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T11:29:52.591 INFO:teuthology.orchestra.run.smithi105.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T11:29:52.591 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-11-20T11:29:52.592 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 2fh/47d Inode: 1 Links: 2 2020-11-20T11:29:52.592 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:29:52.592 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:fusefs_t:s0 2020-11-20T11:29:52.592 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T11:29:52.593 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-11-20 11:29:32.166700568 +0000 2020-11-20T11:29:52.593 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-11-20 11:29:52.526118443 +0000 2020-11-20T11:29:52.593 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-11-20T11:29:52.593 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T11:29:52.594 INFO:teuthology.orchestra.run.smithi105:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T11:29:52.672 INFO:teuthology.orchestra.run.smithi105:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:29:52.786 INFO:tasks.workunit.client.0.smithi105.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T11:30:11.391 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:11.396 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:11.399 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:41.529 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:41.532 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:41.535 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:41.618 INFO:tasks.workunit.client.0.smithi105.stderr:Note: checking out 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T11:30:41.619 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:41.619 INFO:tasks.workunit.client.0.smithi105.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T11:30:41.619 INFO:tasks.workunit.client.0.smithi105.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T11:30:41.620 INFO:tasks.workunit.client.0.smithi105.stderr:state without impacting any branches by performing another checkout. 2020-11-20T11:30:41.620 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:41.620 INFO:tasks.workunit.client.0.smithi105.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T11:30:41.620 INFO:tasks.workunit.client.0.smithi105.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-11-20T11:30:41.621 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:41.621 INFO:tasks.workunit.client.0.smithi105.stderr: git checkout -b 2020-11-20T11:30:41.621 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:41.621 INFO:tasks.workunit.client.0.smithi105.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T11:30:41.623 INFO:teuthology.orchestra.run.smithi105:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T11:30:41.684 INFO:tasks.workunit.client.0.smithi105.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T11:30:41.685 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:30:41.686 INFO:tasks.workunit.client.0.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T11:30:42.346 INFO:tasks.workunit.client.0.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T11:30:42.401 INFO:tasks.workunit.client.0.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T11:30:42.438 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:30:42.439 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:30:42.440 INFO:tasks.workunit.client.0.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T11:30:42.476 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:30:42.479 INFO:teuthology.orchestra.run.smithi105:> set -ex 2020-11-20T11:30:42.479 INFO:teuthology.orchestra.run.smithi105:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:30:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:30:42.535 INFO:teuthology.orchestra.run.smithi105.stdout:rename/prepare.shrename/pri_rem.shrename/pri_nul.shrename/dir_pri_pri.shrename/pri_pri.shrename/rem_nul.shrename/dir_pri_nul.shrename/rem_pri.shrename/rem_rem.shrename/all.shcaps/mon_commands.shdirect_io/big.shdirect_io/misc.shdirect_io/test_short_dio_readdirect_io/direct_io_testdirect_io/test_sync_iokernel_untar_build.shlibcephfs/test.shcephtool/test_daemon.shcephtool/test.shcephtool/test_kvstore_tool.shmgr/test_localpool.shrgw/s3_bucket_quota.plrgw/test_rgw_orphan_list.shrgw/test_rgw_throttle.shrgw/test_rgw_gc_log.shrgw/run-s3tests.shrgw/s3_user_quota.plrgw/test_rgw_obj.shrgw/run-reshard.shrgw/test_rgw_reshard.pyrgw/s3_multipart_upload.plosdc/stress_objectcacher.shpost-file.shsuites/blogbench.shsuites/dbench.shsuites/fsx.shsuites/ffsb.shsuites/fsstress.shsuites/iogen.shsuites/cephfs_journal_tool_smoke.shsuites/fsync-tester.shsuites/dbench-short.shsuites/pjd.shsuites/bonnie.shsuites/iozone.shsuites/iozone-sync.shsuites/fio.shrados/stress_watch.shrados/test_cache_pool.shrados/clone.shrados/test_python.shrados/test_pool_access.shrados/test_crash.shrados/load-gen-mix.shrados/test_health_warnings.shrados/load-gen-mostlyread.shrados/test_pool_quota.shrados/load-gen-mix-small-long.shrados/load-gen-big.shrados/test_librados_build.shrados/test_hang.shrados/version_number_sanity.shrados/test_dedup_tool.shrados/test_envlibrados_for_rocksdb.shrados/test_large_omap_detection.pyrados/test_alloc_hint.shrados/test_rados_timeouts.shrados/load-gen-mix-small.shrados/test.shrados/test_rados_tool.shobjectstore/test_fuse.shcephadm/test_cephadm.shcephadm/create_iscsi_disks.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shceph-helpers-root.sherasure-code/encode-decode-non-regression.sherasure-code/bench.shfs/test_o_truncfs/snap-hierarchy.shfs/norstats/kernel_untar_tar.shfs/test_python.shfs/misc/multiple_rsync.shfs/misc/layout_vxattrs.shfs/misc/chmod.shfs/misc/dirfrag.shfs/misc/xattrs.shfs/misc/filelock_interrupt.pyfs/misc/filelock_deadlock.pyfs/misc/rstats.shfs/misc/subvolume.shfs/misc/trivial_sync.shfs/misc/i_complete_vs_rename.shfs/misc/acl.shfs/misc/mkpool_layout_vxattrs.shfs/misc/direct_io.pyfs/quota/quota.shfs/upgrade/volume_clientfs/snaps/snaptest-double-null.shfs/snaps/snaptest-git-ceph.shfs/snaps/snaptest-2.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-0.shfs/snaps/snaptest-1.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-hardlink.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-realm-split.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-snap-rename.shfs/test_o_trunc.shfs/multiclient_sync_read_eof.pycls/test_cls_rgw.shcls/test_cls_rbd.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_log.shcls/test_cls_lock.shcls/test_cls_cmpomap.shcls/test_cls_journal.shcls/test_cls_2pc_queue.shcls/test_cls_numops.shcls/test_cls_refcount.shrest/test_mgr_rest_api.pyrest/test-restful.shrbd/test_admin_socket.shrbd/test_rbdmap_RBDMAPFILE.shrbd/notify_master.shrbd/journal.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_snapshot.shrbd/krbd_namespaces.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd_mirror_fsx_prepare.shrbd/krbd_huge_osdmap.shrbd/diff.shrbd/rbd_mirror_bootstrap.shrbd/simple_big.shrbd/krbd_fallocate.shrbd/test_librbd.shrbd/rbd_mirror_fsx_compare.shrbd/qemu-iotests.shrbd/krbd_udev_enumerate.shrbd/concurrent.shrbd/rbd-ggate.shrbd/krbd_latest_osdmap_on_map.shrbd/issue-20295.shrbd/import_export.shrbd/notify_slave.shrbd/cli_generic.shrbd/qemu_dynamic_features.shrbd/krbd_data_pool.shrbd/krbd_udev_netns.shrbd/rbd_mirror_ha.shrbd/rbd-nbd.shrbd/rbd_mirror_journal.shrbd/test_librbd_python.shrbd/read-flags.shrbd/krbd_exclusive_option.shrbd/huge-tickets.shrbd/map-snapshot-io.shrbd/image_read.shrbd/diff_continuous.shrbd/permissions.shrbd/map-unmap.shrbd/merge_diff.shrbd/test_rbd_tasks.shrbd/test_lock_fence.shrbd/rbd_mirror_helpers.shrbd/qos.shrbd/kernel.shrbd/krbd_wac.shrbd/rbd_mirror_stress.shrbd/qemu_rebuild_object_map.shrbd/krbd_udev_symlinks.shrbd/rbd_groups.shrbd/verify_pool.shrbd/test_rbd_mirror.shrestart/test-backtraces.pymon/pool_ops.shmon/test_mon_config_key.pymon/caps.shmon/rbd_snaps_ops.shmon/auth_caps.shmon/pg_autoscaler.shmon/test_config_key_caps.shmon/osd.shmon/config.shmon/ping.pymon/test_mon_osdmap_prune.shmon/crush_ops.shceph-tests/ceph-admin-commands.shtrue.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.sh 2020-11-20T11:30:42.536 INFO:teuthology.orchestra.run.smithi105.stderr:9+1 records in 2020-11-20T11:30:42.536 INFO:teuthology.orchestra.run.smithi105.stderr:9+1 records out 2020-11-20T11:30:42.537 INFO:teuthology.orchestra.run.smithi105.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 3.8722e-05 s, 123 MB/s 2020-11-20T11:30:42.537 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2020-11-20T11:30:42.540 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2020-11-20T11:30:42.540 INFO:teuthology.orchestra.run.smithi105:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2020-11-20T11:30:42.622 INFO:tasks.workunit.client.0.smithi105.stderr:--2020-11-20 11:30:42-- http://download.ceph.com/qa/ffsb.tar.bz2 2020-11-20T11:30:42.623 INFO:tasks.workunit.client.0.smithi105.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-11-20T11:30:42.699 INFO:tasks.workunit.client.0.smithi105.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-11-20T11:30:42.778 INFO:tasks.workunit.client.0.smithi105.stderr:HTTP request sent, awaiting response... 200 OK 2020-11-20T11:30:42.778 INFO:tasks.workunit.client.0.smithi105.stderr:Length: 128931 (126K) [application/octet-stream] 2020-11-20T11:30:42.780 INFO:tasks.workunit.client.0.smithi105.stderr:Saving to: ‘ffsb.tar.bz2’ 2020-11-20T11:30:42.784 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:43.425 INFO:tasks.workunit.client.0.smithi105.stderr: 0K .......... .......... .......... .......... .......... 39% 77.7K 1s 2020-11-20T11:30:43.610 INFO:tasks.workunit.client.0.smithi105.stderr: 50K .......... .......... .......... .......... .......... 79% 412K 0s 2020-11-20T11:30:43.679 INFO:tasks.workunit.client.0.smithi105.stderr: 100K .......... .......... ..... 100% 194K=0.9s 2020-11-20T11:30:43.680 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:43.680 INFO:tasks.workunit.client.0.smithi105.stderr:2020-11-20 11:30:43 (140 KB/s) - ‘ffsb.tar.bz2’ saved [128931/128931] 2020-11-20T11:30:43.680 INFO:tasks.workunit.client.0.smithi105.stderr: 2020-11-20T11:30:43.728 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ 2020-11-20T11:30:43.729 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_fs.c 2020-11-20T11:30:43.731 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/INSTALL 2020-11-20T11:30:43.733 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/fileops.c 2020-11-20T11:30:43.736 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/missing 2020-11-20T11:30:43.738 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/config.h.in 2020-11-20T11:30:43.741 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/config.guess 2020-11-20T11:30:43.744 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/fh.h 2020-11-20T11:30:43.746 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/COPYING 2020-11-20T11:30:43.748 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/util.h 2020-11-20T11:30:43.751 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/main.c 2020-11-20T11:30:43.753 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ChangeLog 2020-11-20T11:30:43.755 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rand.c 2020-11-20T11:30:43.757 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_fs.h 2020-11-20T11:30:43.759 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/install-sh 2020-11-20T11:30:43.762 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rwlock.h 2020-11-20T11:30:43.765 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/parser.h 2020-11-20T11:30:43.767 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/filelist.h 2020-11-20T11:30:43.769 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/LICENSE 2020-11-20T11:30:43.771 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/Makefile.in 2020-11-20T11:30:43.774 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/filelist.c 2020-11-20T11:30:43.776 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/configure 2020-11-20T11:30:43.781 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/README 2020-11-20T11:30:43.784 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/cirlist.c 2020-11-20T11:30:43.785 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/metaops.c 2020-11-20T11:30:43.787 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/registration-description 2020-11-20T11:30:43.790 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/list.c 2020-11-20T11:30:43.791 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/list.h 2020-11-20T11:30:43.793 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rand.h 2020-11-20T11:30:43.795 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/parser.c 2020-11-20T11:30:43.797 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_tg.c 2020-11-20T11:30:43.800 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/cirlist.h 2020-11-20T11:30:43.801 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/AUTHORS 2020-11-20T11:30:43.804 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/aclocal.m4 2020-11-20T11:30:43.806 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/configure.in 2020-11-20T11:30:43.808 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/examples/ 2020-11-20T11:30:43.810 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/examples/profile_everything 2020-11-20T11:30:43.812 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/depcomp 2020-11-20T11:30:43.815 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_stats.c 2020-11-20T11:30:43.817 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/util.c 2020-11-20T11:30:43.818 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/Makefile.am 2020-11-20T11:30:43.821 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_thread.c 2020-11-20T11:30:43.825 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rbt.c 2020-11-20T11:30:43.826 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rbt.h 2020-11-20T11:30:43.827 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_tg.h 2020-11-20T11:30:43.829 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/stamp-h.in 2020-11-20T11:30:43.831 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/config.sub 2020-11-20T11:30:43.834 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_thread.h 2020-11-20T11:30:43.835 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/fileops.h 2020-11-20T11:30:43.837 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_op.h 2020-11-20T11:30:43.839 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/public-description 2020-11-20T11:30:43.841 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/mkinstalldirs 2020-11-20T11:30:43.843 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb.h 2020-11-20T11:30:43.845 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/metaops.h 2020-11-20T11:30:43.847 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_op.c 2020-11-20T11:30:43.849 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/fh.c 2020-11-20T11:30:43.851 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/NEWS 2020-11-20T11:30:43.853 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/rwlock.c 2020-11-20T11:30:43.854 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_stats.h 2020-11-20T11:30:43.856 INFO:tasks.workunit.client.0.smithi105.stdout:ffsb-6.0-rc2/ffsb_fc.c 2020-11-20T11:30:43.867 INFO:tasks.workunit.client.0.smithi105.stdout:patching file parser.c 2020-11-20T11:30:43.993 INFO:tasks.workunit.client.0.smithi105.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2020-11-20T11:30:45.002 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether build environment is sane... yes 2020-11-20T11:30:45.019 INFO:tasks.workunit.client.0.smithi105.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2020-11-20T11:30:45.020 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gawk... gawk 2020-11-20T11:30:45.044 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether make sets $(MAKE)... yes 2020-11-20T11:30:45.091 INFO:tasks.workunit.client.0.smithi105.stdout:checking build system type... x86_64-unknown-linux-gnu 2020-11-20T11:30:45.091 INFO:tasks.workunit.client.0.smithi105.stdout:checking host system type... x86_64-unknown-linux-gnu 2020-11-20T11:30:45.111 INFO:tasks.workunit.client.0.smithi105.stdout:checking for style of include used by make... GNU 2020-11-20T11:30:45.116 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gcc... gcc 2020-11-20T11:30:45.200 INFO:tasks.workunit.client.0.smithi105.stdout:checking for C compiler default output file name... a.out 2020-11-20T11:30:45.203 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether the C compiler works... yes 2020-11-20T11:30:45.210 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether we are cross compiling... no 2020-11-20T11:30:45.257 INFO:tasks.workunit.client.0.smithi105.stdout:checking for suffix of executables... 2020-11-20T11:30:45.298 INFO:tasks.workunit.client.0.smithi105.stdout:checking for suffix of object files... o 2020-11-20T11:30:45.338 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether we are using the GNU C compiler... yes 2020-11-20T11:30:45.379 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether gcc accepts -g... yes 2020-11-20T11:30:45.448 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gcc option to accept ISO C89... none needed 2020-11-20T11:30:45.595 INFO:tasks.workunit.client.0.smithi105.stdout:checking dependency style of gcc... gcc3 2020-11-20T11:30:45.655 INFO:tasks.workunit.client.0.smithi105.stdout:checking how to run the C preprocessor... gcc -E 2020-11-20T11:30:45.708 INFO:tasks.workunit.client.0.smithi105.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2020-11-20T11:30:45.709 INFO:tasks.workunit.client.0.smithi105.stdout:checking for egrep... /usr/bin/grep -E 2020-11-20T11:30:45.721 INFO:tasks.workunit.client.0.smithi105.stdout:checking for AIX... no 2020-11-20T11:30:45.748 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gcc... (cached) gcc 2020-11-20T11:30:45.758 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether we are using the GNU C compiler... (cached) yes 2020-11-20T11:30:45.759 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether gcc accepts -g... (cached) yes 2020-11-20T11:30:45.760 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2020-11-20T11:30:45.761 INFO:tasks.workunit.client.0.smithi105.stdout:checking dependency style of gcc... (cached) gcc3 2020-11-20T11:30:45.833 INFO:tasks.workunit.client.0.smithi105.stdout:checking for main in -lm... yes 2020-11-20T11:30:45.907 INFO:tasks.workunit.client.0.smithi105.stdout:checking for main in -lpthread... yes 2020-11-20T11:30:46.101 INFO:tasks.workunit.client.0.smithi105.stdout:checking for ANSI C header files... yes 2020-11-20T11:30:46.160 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2020-11-20T11:30:46.217 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/types.h... yes 2020-11-20T11:30:46.279 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/stat.h... yes 2020-11-20T11:30:46.339 INFO:tasks.workunit.client.0.smithi105.stdout:checking for stdlib.h... yes 2020-11-20T11:30:46.398 INFO:tasks.workunit.client.0.smithi105.stdout:checking for string.h... yes 2020-11-20T11:30:46.463 INFO:tasks.workunit.client.0.smithi105.stdout:checking for memory.h... yes 2020-11-20T11:30:49.145 INFO:tasks.workunit.client.0.smithi105.stdout:checking for strings.h... yes 2020-11-20T11:30:49.145 INFO:tasks.workunit.client.0.smithi105.stdout:checking for inttypes.h... yes 2020-11-20T11:30:49.146 INFO:tasks.workunit.client.0.smithi105.stdout:checking for stdint.h... yes 2020-11-20T11:30:49.146 INFO:tasks.workunit.client.0.smithi105.stdout:checking for unistd.h... yes 2020-11-20T11:30:49.146 INFO:tasks.workunit.client.0.smithi105.stdout:checking pthread.h usability... yes 2020-11-20T11:30:49.146 INFO:tasks.workunit.client.0.smithi105.stdout:checking pthread.h presence... yes 2020-11-20T11:30:49.147 INFO:tasks.workunit.client.0.smithi105.stdout:checking for pthread.h... yes 2020-11-20T11:30:49.147 INFO:tasks.workunit.client.0.smithi105.stdout:checking fcntl.h usability... yes 2020-11-20T11:30:49.147 INFO:tasks.workunit.client.0.smithi105.stdout:checking fcntl.h presence... yes 2020-11-20T11:30:49.147 INFO:tasks.workunit.client.0.smithi105.stdout:checking for fcntl.h... yes 2020-11-20T11:30:49.147 INFO:tasks.workunit.client.0.smithi105.stdout:checking limits.h usability... yes 2020-11-20T11:30:49.148 INFO:tasks.workunit.client.0.smithi105.stdout:checking limits.h presence... yes 2020-11-20T11:30:49.148 INFO:tasks.workunit.client.0.smithi105.stdout:checking for limits.h... yes 2020-11-20T11:30:49.148 INFO:tasks.workunit.client.0.smithi105.stdout:checking for stdint.h... (cached) yes 2020-11-20T11:30:49.148 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/time.h usability... yes 2020-11-20T11:30:49.149 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/time.h presence... yes 2020-11-20T11:30:49.149 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/time.h... yes 2020-11-20T11:30:49.149 INFO:tasks.workunit.client.0.smithi105.stdout:checking for unistd.h... (cached) yes 2020-11-20T11:30:49.149 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/vfs.h usability... yes 2020-11-20T11:30:49.149 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/vfs.h presence... yes 2020-11-20T11:30:49.150 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/vfs.h... yes 2020-11-20T11:30:49.150 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/limits.h usability... no 2020-11-20T11:30:49.150 INFO:tasks.workunit.client.0.smithi105.stdout:checking sys/limits.h presence... no 2020-11-20T11:30:49.150 INFO:tasks.workunit.client.0.smithi105.stdout:checking for sys/limits.h... no 2020-11-20T11:30:49.151 INFO:tasks.workunit.client.0.smithi105.stdout:checking for an ANSI C-conforming const... yes 2020-11-20T11:30:49.151 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether time.h and sys/time.h may both be included... yes 2020-11-20T11:30:49.151 INFO:tasks.workunit.client.0.smithi105.stdout:checking for function prototypes... yes 2020-11-20T11:30:49.151 INFO:tasks.workunit.client.0.smithi105.stdout:checking whether setvbuf arguments are reversed... no 2020-11-20T11:30:49.152 INFO:tasks.workunit.client.0.smithi105.stdout:checking for system... yes 2020-11-20T11:30:49.152 INFO:tasks.workunit.client.0.smithi105.stdout:checking for gettimeofday... yes 2020-11-20T11:30:49.152 INFO:tasks.workunit.client.0.smithi105.stdout:checking for mkdir... yes 2020-11-20T11:30:49.152 INFO:tasks.workunit.client.0.smithi105.stdout:checking for strerror... yes 2020-11-20T11:30:49.152 INFO:tasks.workunit.client.0.smithi105.stdout:checking for open64... yes 2020-11-20T11:30:49.153 INFO:tasks.workunit.client.0.smithi105.stdout:checking for stat64... yes 2020-11-20T11:30:49.153 INFO:tasks.workunit.client.0.smithi105.stdout:checking for fseeko64... yes 2020-11-20T11:30:49.153 INFO:tasks.workunit.client.0.smithi105.stdout:checking for lrand48_r... yes 2020-11-20T11:30:49.153 INFO:tasks.workunit.client.0.smithi105.stdout:checking for srand48_r... yes 2020-11-20T11:30:49.154 INFO:tasks.workunit.client.0.smithi105.stdout:configure: creating ./config.status 2020-11-20T11:30:49.154 INFO:tasks.workunit.client.0.smithi105.stdout:config.status: creating Makefile 2020-11-20T11:30:49.154 INFO:tasks.workunit.client.0.smithi105.stdout:config.status: creating config.h 2020-11-20T11:30:49.154 INFO:tasks.workunit.client.0.smithi105.stdout:config.status: executing depfiles commands 2020-11-20T11:30:49.154 INFO:tasks.workunit.client.0.smithi105.stdout:config.status: executing default commands 2020-11-20T11:30:49.155 INFO:tasks.workunit.client.0.smithi105.stdout:make all-am 2020-11-20T11:30:49.155 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2020-11-20T11:30:49.155 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2020-11-20T11:30:49.155 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2020-11-20T11:30:49.155 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2020-11-20T11:30:49.156 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2020-11-20T11:30:49.156 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2020-11-20T11:30:49.156 INFO:tasks.workunit.client.0.smithi105.stderr:fileops.c: In function ‘ffsb_stat’: 2020-11-20T11:30:49.156 INFO:tasks.workunit.client.0.smithi105.stderr:fileops.c:542:2: warning: implicit declaration of function ‘fhstat’; did you mean ‘fstat’? [-Wimplicit-function-declaration] 2020-11-20T11:30:49.157 INFO:tasks.workunit.client.0.smithi105.stderr: fhstat(curfile->name, ft, fs); 2020-11-20T11:30:49.157 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~ 2020-11-20T11:30:49.157 INFO:tasks.workunit.client.0.smithi105.stderr: fstat 2020-11-20T11:30:49.158 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/main.Tpo .deps/main.Po 2020-11-20T11:30:49.158 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2020-11-20T11:30:49.271 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2020-11-20T11:30:49.277 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2020-11-20T11:30:49.401 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2020-11-20T11:30:49.406 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2020-11-20T11:30:49.474 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2020-11-20T11:30:49.481 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2020-11-20T11:30:49.530 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2020-11-20T11:30:49.536 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2020-11-20T11:30:49.593 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2020-11-20T11:30:49.599 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2020-11-20T11:30:49.764 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2020-11-20T11:30:49.769 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2020-11-20T11:30:49.896 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2020-11-20T11:30:49.901 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2020-11-20T11:30:49.943 INFO:tasks.workunit.client.0.smithi105.stderr:ffsb_fs.c: In function ‘fs_needs_stats’: 2020-11-20T11:30:49.944 INFO:tasks.workunit.client.0.smithi105.stderr:ffsb_fs.c:627:24: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:49.944 INFO:tasks.workunit.client.0.smithi105.stderr: return (fs != NULL) ? (int)fs->fsd.config : 0; 2020-11-20T11:30:49.944 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.057 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2020-11-20T11:30:50.063 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2020-11-20T11:30:50.145 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2020-11-20T11:30:50.151 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2020-11-20T11:30:50.244 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2020-11-20T11:30:50.249 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2020-11-20T11:30:50.359 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/util.Tpo .deps/util.Po 2020-11-20T11:30:50.364 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2020-11-20T11:30:50.403 INFO:tasks.workunit.client.0.smithi105.stderr:In file included from parser.h:22, 2020-11-20T11:30:50.403 INFO:tasks.workunit.client.0.smithi105.stderr: from parser.c:25: 2020-11-20T11:30:50.404 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c: In function ‘init_filesys’: 2020-11-20T11:30:50.405 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.405 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.406 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.407 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.407 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.408 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.408 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.408 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.408 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.409 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.409 INFO:tasks.workunit.client.0.smithi105.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-11-20T11:30:50.409 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.409 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.409 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2020-11-20T11:30:50.410 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.410 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.410 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.410 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.411 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.411 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.411 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.411 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.412 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.412 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.412 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.413 INFO:tasks.workunit.client.0.smithi105.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-11-20T11:30:50.413 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.414 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.414 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2020-11-20T11:30:50.415 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.415 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.415 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.416 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.416 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.416 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.416 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.417 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.417 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.417 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.417 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.418 INFO:tasks.workunit.client.0.smithi105.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-11-20T11:30:50.418 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.418 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.418 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2020-11-20T11:30:50.419 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.419 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.419 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.419 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.419 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.420 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.420 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.420 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.420 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.421 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.421 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.421 INFO:tasks.workunit.client.0.smithi105.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-11-20T11:30:50.421 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.421 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.422 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2020-11-20T11:30:50.422 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.422 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c: In function ‘init_tg_stats’: 2020-11-20T11:30:50.422 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.422 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.423 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.423 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.423 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.423 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.423 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.424 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.424 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.424 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.424 INFO:tasks.workunit.client.0.smithi105.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-11-20T11:30:50.425 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.425 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.425 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, 2020-11-20T11:30:50.425 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.426 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.426 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.426 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.426 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.426 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.427 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.427 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.427 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.427 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.427 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.428 INFO:tasks.workunit.client.0.smithi105.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-11-20T11:30:50.428 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.428 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.429 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, 2020-11-20T11:30:50.429 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.430 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.430 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.430 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.430 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.431 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.431 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.431 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.431 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.431 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.432 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.432 INFO:tasks.workunit.client.0.smithi105.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-11-20T11:30:50.432 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.432 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.432 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, 2020-11-20T11:30:50.433 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.433 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-11-20T11:30:50.433 INFO:tasks.workunit.client.0.smithi105.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-11-20T11:30:50.433 INFO:tasks.workunit.client.0.smithi105.stderr: ^ 2020-11-20T11:30:50.434 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-11-20T11:30:50.434 INFO:tasks.workunit.client.0.smithi105.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-11-20T11:30:50.434 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~ 2020-11-20T11:30:50.434 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-11-20T11:30:50.434 INFO:tasks.workunit.client.0.smithi105.stderr: container_of(ptr, type, member) 2020-11-20T11:30:50.435 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~ 2020-11-20T11:30:50.435 INFO:tasks.workunit.client.0.smithi105.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-11-20T11:30:50.435 INFO:tasks.workunit.client.0.smithi105.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-11-20T11:30:50.436 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~ 2020-11-20T11:30:50.436 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2020-11-20T11:30:50.436 INFO:tasks.workunit.client.0.smithi105.stderr: list_for_each_entry(tmp_list, 2020-11-20T11:30:50.436 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.508 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c: In function ‘set_weight’: 2020-11-20T11:30:50.508 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:623:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2020-11-20T11:30:50.508 INFO:tasks.workunit.client.0.smithi105.stderr: strncpy (op, tmp_config->name, len - 7); 2020-11-20T11:30:50.509 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.509 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:620:10: note: length computed here 2020-11-20T11:30:50.509 INFO:tasks.workunit.client.0.smithi105.stderr: len = strlen(tmp_config->name); 2020-11-20T11:30:50.509 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.512 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c: In function ‘get_weight_total’: 2020-11-20T11:30:50.512 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:645:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2020-11-20T11:30:50.512 INFO:tasks.workunit.client.0.smithi105.stderr: strncpy (op, tmp_config->name, len - 7); 2020-11-20T11:30:50.512 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.513 INFO:tasks.workunit.client.0.smithi105.stderr:parser.c:642:10: note: length computed here 2020-11-20T11:30:50.513 INFO:tasks.workunit.client.0.smithi105.stderr: len = strlen(tmp_config->name); 2020-11-20T11:30:50.513 INFO:tasks.workunit.client.0.smithi105.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2020-11-20T11:30:50.637 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2020-11-20T11:30:50.642 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2020-11-20T11:30:50.714 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2020-11-20T11:30:50.719 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2020-11-20T11:30:50.807 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2020-11-20T11:30:50.812 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2020-11-20T11:30:50.848 INFO:tasks.workunit.client.0.smithi105.stdout:mv -f .deps/list.Tpo .deps/list.Po 2020-11-20T11:30:50.853 INFO:tasks.workunit.client.0.smithi105.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2020-11-20T11:30:50.948 INFO:tasks.workunit.client.0.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2020-11-20T11:30:50.964 INFO:tasks.workunit.client.0.smithi105.stdout:FFSB version 6.0-RC2 started 2020-11-20T11:30:50.964 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.967 INFO:tasks.workunit.client.0.smithi105.stdout:benchmark time = 300 2020-11-20T11:30:50.968 INFO:tasks.workunit.client.0.smithi105.stdout:ThreadGroup 0 2020-11-20T11:30:50.968 INFO:tasks.workunit.client.0.smithi105.stdout:================ 2020-11-20T11:30:50.968 INFO:tasks.workunit.client.0.smithi105.stdout: num_threads = 32 2020-11-20T11:30:50.968 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.968 INFO:tasks.workunit.client.0.smithi105.stdout: read_random = off 2020-11-20T11:30:50.969 INFO:tasks.workunit.client.0.smithi105.stdout: read_size = 0 (0B) 2020-11-20T11:30:50.969 INFO:tasks.workunit.client.0.smithi105.stdout: read_blocksize = 0 (0B) 2020-11-20T11:30:50.969 INFO:tasks.workunit.client.0.smithi105.stdout: read_skip = off 2020-11-20T11:30:50.969 INFO:tasks.workunit.client.0.smithi105.stdout: read_skipsize = 0 (0B) 2020-11-20T11:30:50.970 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.970 INFO:tasks.workunit.client.0.smithi105.stdout: write_random = on 2020-11-20T11:30:50.970 INFO:tasks.workunit.client.0.smithi105.stdout: write_size = 5242880 (5MB) 2020-11-20T11:30:50.970 INFO:tasks.workunit.client.0.smithi105.stdout: fsync_file = 0 2020-11-20T11:30:50.970 INFO:tasks.workunit.client.0.smithi105.stdout: write_blocksize = 4096 (4KB) 2020-11-20T11:30:50.971 INFO:tasks.workunit.client.0.smithi105.stdout: wait time = 0 2020-11-20T11:30:50.971 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.971 INFO:tasks.workunit.client.0.smithi105.stdout: op weights 2020-11-20T11:30:50.971 INFO:tasks.workunit.client.0.smithi105.stdout: read = 0 (0.00%) 2020-11-20T11:30:50.972 INFO:tasks.workunit.client.0.smithi105.stdout: readall = 0 (0.00%) 2020-11-20T11:30:50.972 INFO:tasks.workunit.client.0.smithi105.stdout: write = 1 (100.00%) 2020-11-20T11:30:50.972 INFO:tasks.workunit.client.0.smithi105.stdout: create = 0 (0.00%) 2020-11-20T11:30:50.972 INFO:tasks.workunit.client.0.smithi105.stdout: append = 0 (0.00%) 2020-11-20T11:30:50.972 INFO:tasks.workunit.client.0.smithi105.stdout: delete = 0 (0.00%) 2020-11-20T11:30:50.973 INFO:tasks.workunit.client.0.smithi105.stdout: metaop = 0 (0.00%) 2020-11-20T11:30:50.973 INFO:tasks.workunit.client.0.smithi105.stdout: createdir = 0 (0.00%) 2020-11-20T11:30:50.973 INFO:tasks.workunit.client.0.smithi105.stdout: stat = 0 (0.00%) 2020-11-20T11:30:50.973 INFO:tasks.workunit.client.0.smithi105.stdout: writeall = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: writeall_fsync = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: open_close = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: write_fsync = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: create_fsync = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: append_fsync = 0 (0.00%) 2020-11-20T11:30:50.974 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.975 INFO:tasks.workunit.client.0.smithi105.stdout:FileSystem . 2020-11-20T11:30:50.975 INFO:tasks.workunit.client.0.smithi105.stdout:========== 2020-11-20T11:30:50.975 INFO:tasks.workunit.client.0.smithi105.stdout: num_dirs = 0 2020-11-20T11:30:50.975 INFO:tasks.workunit.client.0.smithi105.stdout: starting files = 128 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: min file size = 104857600 (100MB) 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: max file size = 104857600 (100MB) 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: directio = off 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: alignedio = on 2020-11-20T11:30:50.976 INFO:tasks.workunit.client.0.smithi105.stdout: bufferedio = off 2020-11-20T11:30:50.977 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.977 INFO:tasks.workunit.client.0.smithi105.stdout: aging is off 2020-11-20T11:30:50.977 INFO:tasks.workunit.client.0.smithi105.stdout: current utilization = 0.00% 2020-11-20T11:30:50.977 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:30:50.978 INFO:tasks.workunit.client.0.smithi105.stdout:checking existing fs: . 2020-11-20T11:30:50.978 INFO:tasks.workunit.client.0.smithi105.stdout:recreating new fileset 2020-11-20T11:30:50.978 INFO:tasks.workunit.client.0.smithi105.stderr:opendir: No such file or directory 2020-11-20T11:31:11.685 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:31:11.693 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:31:11.699 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:31:41.847 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:31:41.852 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:31:41.858 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:11.941 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:11.945 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:11.947 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:42.300 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:42.330 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:42.333 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:12.471 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:12.478 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:12.485 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:42.561 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:42.564 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:33:42.567 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:12.650 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:14.804 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:14.806 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:44.887 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:44.891 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:34:44.895 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:15.236 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:15.240 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:15.243 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:45.314 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:45.597 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:35:45.599 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:15.688 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:15.696 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:15.703 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:40.415 INFO:tasks.workunit.client.0.smithi105.stdout:fs setup took 349 secs 2020-11-20T11:36:41.314 INFO:tasks.workunit.client.0.smithi105.stdout:Syncing()...0 sec 2020-11-20T11:36:41.315 INFO:tasks.workunit.client.0.smithi105.stdout:Starting Actual Benchmark At: Fri Nov 20 11:36:41 2020 2020-11-20T11:36:41.315 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:36:45.781 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:45.795 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:36:45.810 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:16.446 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:16.450 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:16.453 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:49.793 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:49.795 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:49.798 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:20.514 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:20.517 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:20.519 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:51.066 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:51.068 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:51.953 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:25.708 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:25.996 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:25.998 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:58.639 INFO:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:58.643 INFO:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:58.645 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:59.152 INFO:tasks.ceph.osd.0.smithi105.stderr:2020-11-20T11:39:59.148+0000 7fcd2fd6c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35947) UID: 0 2020-11-20T11:39:59.153 INFO:tasks.ceph.osd.3.smithi105.stderr:2020-11-20T11:39:59.148+0000 7fe102030700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35947) UID: 0 2020-11-20T11:39:59.153 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-11-20T11:39:59.149+0000 7f283e130700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35947) UID: 0 2020-11-20T11:39:59.390 INFO:tasks.ceph.osd.9.smithi105.stderr:2020-11-20T11:39:59.149+0000 7efc2ea5f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35947) UID: 0 2020-11-20T11:39:59.422 INFO:tasks.ceph.osd.2.smithi067.stderr:2020-11-20T11:39:59.418+0000 7f3c3872d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 28163) UID: 0 2020-11-20T11:39:59.422 INFO:tasks.ceph.osd.5.smithi067.stderr:2020-11-20T11:39:59.419+0000 7f5dab056700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 28163) UID: 0 2020-11-20T11:39:59.423 INFO:tasks.ceph.osd.11.smithi067.stderr:2020-11-20T11:39:59.418+0000 7ff828767700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 28163) UID: 0 2020-11-20T11:39:59.423 INFO:tasks.ceph.osd.8.smithi067.stderr:2020-11-20T11:39:59.419+0000 7f69c0081700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 28163) UID: 0 2020-11-20T11:39:59.670 INFO:tasks.ceph.osd.7.smithi100.stderr:2020-11-20T11:39:59.666+0000 7fef2a974700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 27718) UID: 0 2020-11-20T11:39:59.687 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:39:59.666+0000 7f9a0417e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 27718) UID: 0 2020-11-20T11:39:59.693 INFO:tasks.ceph.osd.10.smithi100.stderr:2020-11-20T11:39:59.666+0000 7fa4808cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 27718) UID: 0 2020-11-20T11:39:59.701 INFO:tasks.ceph.osd.4.smithi100.stderr:2020-11-20T11:39:59.666+0000 7f264ab2e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 27718) UID: 0 2020-11-20T11:40:49.778 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:49.724+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4661.0:42008 4.3s0 4:d7e5293e:::100000003bd.00000005:head [write 1671168~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:50.769 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:50.760+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4661.0:42149 4.3s0 4:d3cee52d:::100000003c1.0000000f:head [write 2981888~4096 in=4096b,write 3158016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:51.804 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:51.799+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4661.0:42627 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 880640~4096 in=4096b,write 3387392~4096 in=4096b,write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:52.805 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:52.767+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4661.0:42627 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 880640~4096 in=4096b,write 3387392~4096 in=4096b,write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:53.760 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:53.757+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4661.0:42627 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 880640~4096 in=4096b,write 3387392~4096 in=4096b,write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:54.807 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:54.784+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4661.0:42627 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 880640~4096 in=4096b,write 3387392~4096 in=4096b,write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:55.831 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:55.828+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4661.0:42627 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 880640~4096 in=4096b,write 3387392~4096 in=4096b,write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:56.840 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:56.813+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4661.0:42805 4.3s0 4:d1f9ee67:::1000000035d.00000015:head [write 3690496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:57.910 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:57.859+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4661.0:43401 4.3s0 4:cadf94e7:::10000000382.00000014:head [write 3108864~4096 in=4096b,write 3215360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:40:58.952 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:58.925+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4661.0:43401 4.3s0 4:cadf94e7:::10000000382.00000014:head [write 3108864~4096 in=4096b,write 3215360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:00.007 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:40:59.965+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4661.0:43401 4.3s0 4:cadf94e7:::10000000382.00000014:head [write 3108864~4096 in=4096b,write 3215360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:00.977 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:00.932+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4661.0:43401 4.3s0 4:cadf94e7:::10000000382.00000014:head [write 3108864~4096 in=4096b,write 3215360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:01.944 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:01.917+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4661.0:43401 4.3s0 4:cadf94e7:::10000000382.00000014:head [write 3108864~4096 in=4096b,write 3215360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:03.004 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:02.948+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4661.0:43509 4.3s0 4:d7d88203:::100000003c5.00000014:head [write 1425408~4096 in=4096b,write 1888256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:04.015 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:04.009+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4661.0:43509 4.3s0 4:d7d88203:::100000003c5.00000014:head [write 1425408~4096 in=4096b,write 1888256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:05.085 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:05.075+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4661.0:43613 4.3s0 4:de41c339:::100000003b0.00000007:head [write 3977216~4096 in=4096b,write 4145152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:06.151 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:06.121+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4661.0:43840 4.3s0 4:dc3cbfdf:::100000003b3.00000005:head [write 1658880~4096 in=4096b,write 2027520~4096 in=4096b,write 2506752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:07.141 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:07.089+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4661.0:43910 4.3s0 4:cf9a8707:::100000003a2.00000001:head [write 2940928~4096 in=4096b,write 3411968~4096 in=4096b,write 3616768~4096 in=4096b,write 4001792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:08.167 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:08.112+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4661.0:44058 4.3s0 4:de3e3072:::10000000356.00000007:head [write 212992~4096 in=4096b,write 589824~4096 in=4096b,write 1224704~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:09.169 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:09.114+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4661.0:44576 4.3s0 4:d860ecf3:::10000000382.0000000b:head [write 4034560~4096 in=4096b,write 4096000~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:10.122 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:10.069+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4661.0:44576 4.3s0 4:d860ecf3:::10000000382.0000000b:head [write 4034560~4096 in=4096b,write 4096000~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:11.102 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:11.073+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4661.0:44576 4.3s0 4:d860ecf3:::10000000382.0000000b:head [write 4034560~4096 in=4096b,write 4096000~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:12.137 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:12.132+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4661.0:44576 4.3s0 4:d860ecf3:::10000000382.0000000b:head [write 4034560~4096 in=4096b,write 4096000~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:13.215 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:13.186+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4661.0:44576 4.3s0 4:d860ecf3:::10000000382.0000000b:head [write 4034560~4096 in=4096b,write 4096000~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:14.273 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:14.226+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4661.0:44668 4.3s0 4:cef2f395:::10000000395.00000018:head [write 1593344~4096 in=4096b,write 2150400~4096 in=4096b,write 2580480~4096 in=4096b,write 3174400~4096 in=4096b,write 3342336~4096 in=4096b,write 3772416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:15.274 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:15.248+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4661.0:45038 4.3s0 4:c6856389:::100000003c5.00000011:head [write 270336~4096 in=4096b,write 278528~4096 in=4096b,write 299008~4096 in=4096b,write 942080~4096 in=4096b,write 983040~4096 in=4096b,write 1404928~4096 in=4096b,write 2478080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:16.294 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:16.246+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4661.0:45038 4.3s0 4:c6856389:::100000003c5.00000011:head [write 270336~4096 in=4096b,write 278528~4096 in=4096b,write 299008~4096 in=4096b,write 942080~4096 in=4096b,write 983040~4096 in=4096b,write 1404928~4096 in=4096b,write 2478080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:17.303 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:17.298+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4661.0:45038 4.3s0 4:c6856389:::100000003c5.00000011:head [write 270336~4096 in=4096b,write 278528~4096 in=4096b,write 299008~4096 in=4096b,write 942080~4096 in=4096b,write 983040~4096 in=4096b,write 1404928~4096 in=4096b,write 2478080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:18.358 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:18.328+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4661.0:45392 4.3s0 4:ccf6b766:::100000003a9.00000008:head [write 0~4096 in=4096b,write 77824~4096 in=4096b,write 327680~4096 in=4096b,write 1515520~4096 in=4096b,write 2994176~4096 in=4096b,write 3317760~4096 in=4096b,write 3330048~4096 in=4096b,write 3485696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:19.405 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:19.399+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4661.0:45392 4.3s0 4:ccf6b766:::100000003a9.00000008:head [write 0~4096 in=4096b,write 77824~4096 in=4096b,write 327680~4096 in=4096b,write 1515520~4096 in=4096b,write 2994176~4096 in=4096b,write 3317760~4096 in=4096b,write 3330048~4096 in=4096b,write 3485696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:20.426 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:20.387+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4661.0:45676 4.3s0 4:cc682008:::100000003a6.00000006:head [write 1691648~4096 in=4096b,write 3055616~4096 in=4096b,write 3698688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:21.452 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:21.409+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4661.0:45676 4.3s0 4:cc682008:::100000003a6.00000006:head [write 1691648~4096 in=4096b,write 3055616~4096 in=4096b,write 3698688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:22.488 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:22.465+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4661.0:46118 4.3s0 4:c68b2c12:::100000003b8.00000002:head [write 225280~4096 in=4096b,write 679936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:23.559 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:23.531+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4661.0:46118 4.3s0 4:c68b2c12:::100000003b8.00000002:head [write 225280~4096 in=4096b,write 679936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:24.571 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:24.542+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 23 slow ops, oldest is osd_op(client.4661.0:46118 4.3s0 4:c68b2c12:::100000003b8.00000002:head [write 225280~4096 in=4096b,write 679936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:25.575 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:25.530+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4661.0:46118 4.3s0 4:c68b2c12:::100000003b8.00000002:head [write 225280~4096 in=4096b,write 679936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:26.559 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:26.556+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4661.0:46569 4.3s0 4:df91b802:::100000003a2.00000016:head [write 3104768~4096 in=4096b,write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:27.649 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:27.620+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 25 slow ops, oldest is osd_op(client.4661.0:46569 4.3s0 4:df91b802:::100000003a2.00000016:head [write 3104768~4096 in=4096b,write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:28.729 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:28.658+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4661.0:46569 4.3s0 4:df91b802:::100000003a2.00000016:head [write 3104768~4096 in=4096b,write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:29.738 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:29.707+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4661.0:46665 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 3842048~4096 in=4096b,write 4014080~4096 in=4096b,write 4034560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:30.769 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:30.739+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4661.0:46774 4.3s0 4:dfb62ae6:::1000000035b.00000017:head [write 2977792~4096 in=4096b,write 3207168~4096 in=4096b,write 3559424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:31.842 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:31.812+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4661.0:47095 4.3s0 4:db4accfa:::1000000036f.00000006:head [write 1581056~4096 in=4096b,write 1716224~4096 in=4096b,write 1740800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:32.876 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:32.822+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4661.0:47095 4.3s0 4:db4accfa:::1000000036f.00000006:head [write 1581056~4096 in=4096b,write 1716224~4096 in=4096b,write 1740800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:33.875 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:33.824+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4661.0:47095 4.3s0 4:db4accfa:::1000000036f.00000006:head [write 1581056~4096 in=4096b,write 1716224~4096 in=4096b,write 1740800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:34.844 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:34.814+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4661.0:47676 4.3s0 4:dfb62ae6:::1000000035b.00000017:head [write 1187840~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:35.840 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:35.815+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4661.0:47676 4.3s0 4:dfb62ae6:::1000000035b.00000017:head [write 1187840~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:36.874 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:36.808+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4661.0:47676 4.3s0 4:dfb62ae6:::1000000035b.00000017:head [write 1187840~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:37.853 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:37.827+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4661.0:47676 4.3s0 4:dfb62ae6:::1000000035b.00000017:head [write 1187840~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:38.882 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:38.829+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4661.0:47988 4.3s0 4:caeecee0:::10000000395.00000011:head [write 2256896~4096 in=4096b,write 2273280~4096 in=4096b,write 2465792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:39.940 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:39.889+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4661.0:47988 4.3s0 4:caeecee0:::10000000395.00000011:head [write 2256896~4096 in=4096b,write 2273280~4096 in=4096b,write 2465792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:40.944 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:40.894+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4661.0:48172 4.3s0 4:cd656d01:::1000000039c.00000015:head [write 2629632~4096 in=4096b,write 2760704~4096 in=4096b,write 4018176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:41.910 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:41.905+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4661.0:48434 4.3s0 4:ce4e10bf:::1000000035a.0000000d:head [write 880640~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:43.007 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:43.003+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4661.0:48434 4.3s0 4:ce4e10bf:::1000000035a.0000000d:head [write 880640~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:44.039 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:43.971+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4661.0:48537 4.3s0 4:d39e417b:::10000000370.00000011:head [write 1007616~4096 in=4096b,write 2195456~4096 in=4096b,write 3805184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:45.026 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:44.970+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4661.0:49227 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 2260992~4096 in=4096b,write 2998272~4096 in=4096b,write 3596288~4096 in=4096b,write 3698688~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:46.031 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:45.977+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4661.0:49227 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 2260992~4096 in=4096b,write 2998272~4096 in=4096b,write 3596288~4096 in=4096b,write 3698688~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:47.016 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:46.967+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4661.0:49227 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 2260992~4096 in=4096b,write 2998272~4096 in=4096b,write 3596288~4096 in=4096b,write 3698688~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:47.997 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:47.943+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4661.0:49227 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 2260992~4096 in=4096b,write 2998272~4096 in=4096b,write 3596288~4096 in=4096b,write 3698688~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:49.070 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:49.018+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 38 slow ops, oldest is osd_op(client.4661.0:49227 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 2260992~4096 in=4096b,write 2998272~4096 in=4096b,write 3596288~4096 in=4096b,write 3698688~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:50.074 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:50.023+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 37 slow ops, oldest is osd_op(client.4661.0:49459 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 2740224~4096 in=4096b,write 2842624~4096 in=4096b,write 3428352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:51.063 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:51.056+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 37 slow ops, oldest is osd_op(client.4661.0:49492 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 2342912~4096 in=4096b,write 3817472~4096 in=4096b,write 4153344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:52.199 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:52.147+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 38 slow ops, oldest is osd_op(client.4661.0:49840 4.3s0 4:d39e417b:::10000000370.00000011:head [write 2117632~4096 in=4096b,write 2494464~4096 in=4096b,write 3784704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:53.197 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:53.172+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 42 slow ops, oldest is osd_op(client.4661.0:49840 4.3s0 4:d39e417b:::10000000370.00000011:head [write 2117632~4096 in=4096b,write 2494464~4096 in=4096b,write 3784704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:54.222 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:54.204+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 43 slow ops, oldest is osd_op(client.4661.0:50357 4.3s0 4:cd656d01:::1000000039c.00000015:head [write 1789952~4096 in=4096b,write 2056192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:55.289 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:55.261+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 43 slow ops, oldest is osd_op(client.4661.0:50357 4.3s0 4:cd656d01:::1000000039c.00000015:head [write 1789952~4096 in=4096b,write 2056192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:56.336 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:56.310+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 43 slow ops, oldest is osd_op(client.4661.0:50357 4.3s0 4:cd656d01:::1000000039c.00000015:head [write 1789952~4096 in=4096b,write 2056192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:57.394 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:57.348+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 44 slow ops, oldest is osd_op(client.4661.0:50526 4.3s0 4:cc85dac3:::1000000034f.00000017:head [write 794624~4096 in=4096b,write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:58.374 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:58.326+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 44 slow ops, oldest is osd_op(client.4661.0:50682 4.3s0 4:c4184389:::10000000378.00000002:head [write 2732032~4096 in=4096b,write 3104768~4096 in=4096b,write 4132864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:41:59.355 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:41:59.349+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 44 slow ops, oldest is osd_op(client.4661.0:50995 4.3s0 4:dd75b67c:::10000000370.00000006:head [write 1531904~4096 in=4096b,write 3047424~4096 in=4096b,write 3325952~4096 in=4096b,write 3465216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:00.475 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:00.449+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 45 slow ops, oldest is osd_op(client.4661.0:50995 4.3s0 4:dd75b67c:::10000000370.00000006:head [write 1531904~4096 in=4096b,write 3047424~4096 in=4096b,write 3325952~4096 in=4096b,write 3465216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:01.493 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:01.465+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 45 slow ops, oldest is osd_op(client.4661.0:51721 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 1064960~4096 in=4096b,write 1351680~4096 in=4096b,write 2461696~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:02.548 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:02.518+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 47 slow ops, oldest is osd_op(client.4661.0:51721 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 1064960~4096 in=4096b,write 1351680~4096 in=4096b,write 2461696~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:03.528 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:03.480+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4661.0:51721 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 1064960~4096 in=4096b,write 1351680~4096 in=4096b,write 2461696~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:04.520 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:04.495+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 50 slow ops, oldest is osd_op(client.4661.0:51721 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 1064960~4096 in=4096b,write 1351680~4096 in=4096b,write 2461696~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:05.533 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:05.515+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 52 slow ops, oldest is osd_op(client.4661.0:51721 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 1064960~4096 in=4096b,write 1351680~4096 in=4096b,write 2461696~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:06.623 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:06.580+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 50 slow ops, oldest is osd_op(client.4661.0:51900 4.3s0 4:c63f8479:::10000000352.0000000d:head [write 1253376~4096 in=4096b,write 2834432~4096 in=4096b,write 2899968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:07.618 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:07.568+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 53 slow ops, oldest is osd_op(client.4661.0:52128 4.3s0 4:c24bd8c4:::1000000035f.00000014:head [write 434176~4096 in=4096b,write 1204224~4096 in=4096b,write 1359872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:08.604 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:08.556+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 56 slow ops, oldest is osd_op(client.4661.0:52355 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 1777664~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:09.647 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:09.608+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 62 slow ops, oldest is osd_op(client.4661.0:52355 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 1777664~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:10.679 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:10.631+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 63 slow ops, oldest is osd_op(client.4661.0:52604 4.3s0 4:d4112014:::1000000039a.00000007:head [write 663552~4096 in=4096b,write 1093632~4096 in=4096b,write 2363392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:11.693 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:11.650+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 64 slow ops, oldest is osd_op(client.4661.0:52969 4.3s0 4:df27832b:::10000000395.00000007:head [write 1945600~4096 in=4096b,write 2170880~4096 in=4096b,write 2514944~4096 in=4096b,write 3039232~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:12.674 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:12.618+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 68 slow ops, oldest is osd_op(client.4661.0:52969 4.3s0 4:df27832b:::10000000395.00000007:head [write 1945600~4096 in=4096b,write 2170880~4096 in=4096b,write 2514944~4096 in=4096b,write 3039232~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:13.659 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:13.628+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 70 slow ops, oldest is osd_op(client.4661.0:52969 4.3s0 4:df27832b:::10000000395.00000007:head [write 1945600~4096 in=4096b,write 2170880~4096 in=4096b,write 2514944~4096 in=4096b,write 3039232~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:14.667 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:14.664+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 73 slow ops, oldest is osd_op(client.4661.0:53200 4.3s0 4:c4028c71:::10000000378.00000007:head [write 1736704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:15.721 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:15.669+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 75 slow ops, oldest is osd_op(client.4661.0:53200 4.3s0 4:c4028c71:::10000000378.00000007:head [write 1736704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:16.742 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:16.684+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 77 slow ops, oldest is osd_op(client.4661.0:53399 4.3s0 4:c4954b16:::100000003a4.00000000:head [write 2076672~4096 in=4096b,write 3850240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:17.774 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:17.718+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 82 slow ops, oldest is osd_op(client.4661.0:53399 4.3s0 4:c4954b16:::100000003a4.00000000:head [write 2076672~4096 in=4096b,write 3850240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:18.797 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:18.743+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 80 slow ops, oldest is osd_op(client.4661.0:53618 4.3s0 4:d74f488c:::1000000035a.00000004:head [write 389120~4096 in=4096b,write 573440~4096 in=4096b,write 1093632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:19.865 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:19.809+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 81 slow ops, oldest is osd_op(client.4661.0:53992 4.3s0 4:d93e1e4b:::100000003a6.00000018:head [write 3067904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:20.890 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:20.864+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4661.0:53992 4.3s0 4:d93e1e4b:::100000003a6.00000018:head [write 3067904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:21.906 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:21.837+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4661.0:54098 4.3s0 4:d7d588ed:::10000000399.00000009:head [write 184320~4096 in=4096b,write 585728~4096 in=4096b,write 1007616~4096 in=4096b,write 1691648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:22.920 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:22.872+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4661.0:54328 4.3s0 4:c797c37d:::10000000391.00000007:head [write 311296~4096 in=4096b,write 475136~4096 in=4096b,write 1761280~4096 in=4096b,write 3526656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:23.919 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:23.894+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 88 slow ops, oldest is osd_op(client.4661.0:54328 4.3s0 4:c797c37d:::10000000391.00000007:head [write 311296~4096 in=4096b,write 475136~4096 in=4096b,write 1761280~4096 in=4096b,write 3526656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:24.958 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:24.908+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 87 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:25.965 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:25.919+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 88 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:27.002 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:26.962+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 90 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:28.024 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:27.975+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 93 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:29.050 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:29.021+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:30.146 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:30.093+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 100 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:31.155 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:31.083+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 104 slow ops, oldest is osd_op(client.4661.0:55432 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:32.177 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:32.125+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 104 slow ops, oldest is osd_op(client.4661.0:55969 4.3s0 4:c68962e5:::10000000354.00000007:head [write 2797568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:33.235 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:33.186+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 104 slow ops, oldest is osd_op(client.4661.0:55969 4.3s0 4:c68962e5:::10000000354.00000007:head [write 2797568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:34.576 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:34.449+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 103 slow ops, oldest is osd_op(client.4661.0:55969 4.3s0 4:c68962e5:::10000000354.00000007:head [write 2797568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:35.567 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:35.471+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 106 slow ops, oldest is osd_op(client.4661.0:55969 4.3s0 4:c68962e5:::10000000354.00000007:head [write 2797568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:36.528 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:36.478+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 105 slow ops, oldest is osd_op(client.4661.0:56191 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:37.488 INFO:tasks.workunit.client.0.smithi105.stdout:Syncing()...3 sec 2020-11-20T11:42:37.489 INFO:tasks.workunit.client.0.smithi105.stdout:FFSB benchmark finished at: Fri Nov 20 11:42:37 2020 2020-11-20T11:42:37.489 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.489 INFO:tasks.workunit.client.0.smithi105.stdout:Results: 2020-11-20T11:42:37.489 INFO:tasks.workunit.client.0.smithi105.stdout:Benchmark took 356.17 sec 2020-11-20T11:42:37.490 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.490 INFO:tasks.workunit.client.0.smithi105.stdout:Total Results 2020-11-20T11:42:37.490 INFO:tasks.workunit.client.0.smithi105.stdout:=============== 2020-11-20T11:42:37.490 INFO:tasks.workunit.client.0.smithi105.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2020-11-20T11:42:37.490 INFO:tasks.workunit.client.0.smithi105.stdout: ======= ============ ========= ======= =========== ========== 2020-11-20T11:42:37.491 INFO:tasks.workunit.client.0.smithi105.stdout: write : 281600 790.63 100.000% 100.000% 61.8MB/sec 2020-11-20T11:42:37.491 INFO:tasks.workunit.client.0.smithi105.stdout:- 2020-11-20T11:42:37.491 INFO:tasks.workunit.client.0.smithi105.stdout:790.63 Transactions per Second 2020-11-20T11:42:37.491 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.491 INFO:tasks.workunit.client.0.smithi105.stdout:Throughput Results 2020-11-20T11:42:37.492 INFO:tasks.workunit.client.0.smithi105.stdout:=================== 2020-11-20T11:42:37.493 INFO:tasks.workunit.client.0.smithi105.stdout:Write Throughput: 61.8MB/sec 2020-11-20T11:42:37.493 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.493 INFO:tasks.workunit.client.0.smithi105.stdout:System Call Latency statistics in millisecs 2020-11-20T11:42:37.493 INFO:tasks.workunit.client.0.smithi105.stdout:===== 2020-11-20T11:42:37.493 INFO:tasks.workunit.client.0.smithi105.stdout: Min Avg Max Total Calls 2020-11-20T11:42:37.494 INFO:tasks.workunit.client.0.smithi105.stdout: ======== ======== ======== ============ 2020-11-20T11:42:37.494 INFO:tasks.workunit.client.0.smithi105.stdout:[ open] 0.678000 9.633941 56.780998 220 2020-11-20T11:42:37.494 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-11-20T11:42:37.494 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-11-20T11:42:37.494 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-11-20T11:42:37.495 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2020-11-20T11:42:37.495 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2020-11-20T11:42:37.495 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2020-11-20T11:42:37.496 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2020-11-20T11:42:37.496 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 31 2020-11-20T11:42:37.496 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 18 2020-11-20T11:42:37.496 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 46 2020-11-20T11:42:37.496 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 86 2020-11-20T11:42:37.497 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 30 2020-11-20T11:42:37.497 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2020-11-20T11:42:37.497 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2020-11-20T11:42:37.497 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2020-11-20T11:42:37.497 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2020-11-20T11:42:37.498 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2020-11-20T11:42:37.498 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-11-20T11:42:37.498 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-11-20T11:42:37.498 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.498 INFO:tasks.workunit.client.0.smithi105.stdout:[ write] 0.083000 38.078217 1618.239990 281600 2020-11-20T11:42:37.499 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-11-20T11:42:37.499 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-11-20T11:42:37.499 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 91 2020-11-20T11:42:37.499 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 1139 2020-11-20T11:42:37.500 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 8673 2020-11-20T11:42:37.500 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 18297 2020-11-20T11:42:37.500 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 29976 2020-11-20T11:42:37.500 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 50675 2020-11-20T11:42:37.500 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 40115 2020-11-20T11:42:37.501 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 41659 2020-11-20T11:42:37.501 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 44063 2020-11-20T11:42:37.501 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 18077 2020-11-20T11:42:37.501 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 8123 2020-11-20T11:42:37.501 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 11620 2020-11-20T11:42:37.502 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 8951 2020-11-20T11:42:37.502 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 141 2020-11-20T11:42:37.502 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2020-11-20T11:42:37.502 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-11-20T11:42:37.502 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-11-20T11:42:37.503 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.503 INFO:tasks.workunit.client.0.smithi105.stdout:[ lseek] 0.000000 0.001013 0.143000 281600 2020-11-20T11:42:37.503 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-11-20T11:42:37.503 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-11-20T11:42:37.503 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-11-20T11:42:37.504 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2020-11-20T11:42:37.504 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2020-11-20T11:42:37.504 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2020-11-20T11:42:37.504 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2020-11-20T11:42:37.504 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2020-11-20T11:42:37.505 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2020-11-20T11:42:37.505 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2020-11-20T11:42:37.505 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2020-11-20T11:42:37.505 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2020-11-20T11:42:37.505 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2020-11-20T11:42:37.506 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2020-11-20T11:42:37.506 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2020-11-20T11:42:37.506 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2020-11-20T11:42:37.506 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 8 2020-11-20T11:42:37.506 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 120 2020-11-20T11:42:37.507 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 281469 2020-11-20T11:42:37.507 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.507 INFO:tasks.workunit.client.0.smithi105.stdout:[ close] 0.020000 7.144477 507.367004 220 2020-11-20T11:42:37.507 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-11-20T11:42:37.507 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-11-20T11:42:37.508 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-11-20T11:42:37.508 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 1 2020-11-20T11:42:37.508 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2020-11-20T11:42:37.508 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2020-11-20T11:42:37.508 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 6 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 4 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 4 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 12 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 14 2020-11-20T11:42:37.509 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 16 2020-11-20T11:42:37.510 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 28 2020-11-20T11:42:37.510 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 37 2020-11-20T11:42:37.510 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 38 2020-11-20T11:42:37.510 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 53 2020-11-20T11:42:37.510 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-11-20T11:42:37.511 INFO:tasks.workunit.client.0.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-11-20T11:42:37.511 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.511 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.511 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.511 INFO:tasks.workunit.client.0.smithi105.stdout: 2020-11-20T11:42:37.512 INFO:tasks.workunit.client.0.smithi105.stdout:0.1% User Time 2020-11-20T11:42:37.512 INFO:tasks.workunit.client.0.smithi105.stdout:6.4% System Time 2020-11-20T11:42:37.512 INFO:tasks.workunit.client.0.smithi105.stdout:6.6% CPU Utilization 2020-11-20T11:42:37.532 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:37.485+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 105 slow ops, oldest is osd_op(client.4661.0:56310 4.3s0 4:c64c41cc:::10000000391.0000000d:head [write 2252800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:38.420 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T11:42:38.420 INFO:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T11:42:38.566 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:38.503+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 104 slow ops, oldest is osd_op(client.4661.0:56387 4.3s0 4:c70cc3da:::10000000352.00000009:head [write 765952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:38.889 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2020-11-20T11:42:38.890 INFO:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T11:42:39.493 DEBUG:teuthology.parallel:result is None 2020-11-20T11:42:39.494 INFO:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T11:42:39.541 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T11:42:39.542 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2020-11-20T11:42:39.549 DEBUG:tasks.check_counter:Getting stats from a 2020-11-20T11:42:39.551 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-11-20T11:42:39.561 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:39.515+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 106 slow ops, oldest is osd_op(client.4661.0:56764 4.3s0 4:dbf51981:::10000000355.00000008:head [write 2207744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:40.589 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:40.544+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 107 slow ops, oldest is osd_op(client.4661.0:56764 4.3s0 4:dbf51981:::10000000355.00000008:head [write 2207744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:41.589 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:41.535+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 110 slow ops, oldest is osd_op(client.4661.0:56827 4.3s0 4:c7ea06cc:::10000000367.0000000f:head [write 364544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:41.802 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:42:41.802 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T11:42:41.802 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 1, 2020-11-20T11:42:41.802 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 2, 2020-11-20T11:42:41.803 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 107, 2020-11-20T11:42:41.803 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 140, 2020-11-20T11:42:41.803 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2020-11-20T11:42:41.803 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 18446744073709551614, 2020-11-20T11:42:41.803 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.001275563, 2020-11-20T11:42:41.804 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.000013565, 2020-11-20T11:42:41.804 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.000254759, 2020-11-20T11:42:41.804 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T11:42:41.804 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:41.804 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1, 2020-11-20T11:42:41.805 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000386380, 2020-11-20T11:42:41.805 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000386380 2020-11-20T11:42:41.805 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.805 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:41.806 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2020-11-20T11:42:41.806 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2020-11-20T11:42:41.806 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2020-11-20T11:42:41.806 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:42:41.806 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.807 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T11:42:41.807 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 2, 2020-11-20T11:42:41.807 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 163, 2020-11-20T11:42:41.807 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 267, 2020-11-20T11:42:41.807 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 94556, 2020-11-20T11:42:41.808 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 3, 2020-11-20T11:42:41.808 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 0, 2020-11-20T11:42:41.808 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.006730676, 2020-11-20T11:42:41.808 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.004979000, 2020-11-20T11:42:41.808 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.000752558, 2020-11-20T11:42:41.809 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T11:42:41.809 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:41.809 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 162, 2020-11-20T11:42:41.809 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.006731885, 2020-11-20T11:42:41.809 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000041554 2020-11-20T11:42:41.810 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.810 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:41.810 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2020-11-20T11:42:41.810 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2020-11-20T11:42:41.810 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2020-11-20T11:42:41.811 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:42:41.811 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.811 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T11:42:41.811 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 210, 2020-11-20T11:42:41.812 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 207, 2020-11-20T11:42:41.812 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 159984, 2020-11-20T11:42:41.812 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 113312, 2020-11-20T11:42:41.812 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 2, 2020-11-20T11:42:41.812 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 0, 2020-11-20T11:42:41.813 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.022287798, 2020-11-20T11:42:41.813 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.009198976, 2020-11-20T11:42:41.813 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.007406808, 2020-11-20T11:42:41.813 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.003866398, 2020-11-20T11:42:41.813 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:41.814 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 207, 2020-11-20T11:42:41.814 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.005849807, 2020-11-20T11:42:41.814 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000028259 2020-11-20T11:42:41.814 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.814 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:41.815 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2020-11-20T11:42:41.815 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2020-11-20T11:42:41.815 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2020-11-20T11:42:41.815 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:42:41.815 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.816 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2020-11-20T11:42:41.816 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 0, 2020-11-20T11:42:41.816 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2020-11-20T11:42:41.816 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.816 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2020-11-20T11:42:41.817 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2020-11-20T11:42:41.817 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2020-11-20T11:42:41.817 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T11:42:41.817 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2020-11-20T11:42:41.818 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T11:42:41.818 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2020-11-20T11:42:41.818 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T11:42:41.818 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T11:42:41.818 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T11:42:41.819 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T11:42:41.819 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T11:42:41.819 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2020-11-20T11:42:41.819 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T11:42:41.819 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Buffer_items": 0, 2020-11-20T11:42:41.820 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T11:42:41.820 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Extent_items": 0, 2020-11-20T11:42:41.820 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T11:42:41.820 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_Blob_items": 0, 2020-11-20T11:42:41.820 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T11:42:41.821 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T11:42:41.821 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T11:42:41.821 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T11:42:41.821 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T11:42:41.821 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2020-11-20T11:42:41.822 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2020-11-20T11:42:41.822 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2020-11-20T11:42:41.822 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T11:42:41.822 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T11:42:41.822 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2020-11-20T11:42:41.823 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2020-11-20T11:42:41.823 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2020-11-20T11:42:41.823 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2020-11-20T11:42:41.823 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T11:42:41.823 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2020-11-20T11:42:41.824 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T11:42:41.824 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2020-11-20T11:42:41.824 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 89650, 2020-11-20T11:42:41.824 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 38, 2020-11-20T11:42:41.824 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2020-11-20T11:42:41.825 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2020-11-20T11:42:41.825 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2020-11-20T11:42:41.825 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2020-11-20T11:42:41.825 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2020-11-20T11:42:41.826 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2020-11-20T11:42:41.826 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2020-11-20T11:42:41.826 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2020-11-20T11:42:41.826 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 0, 2020-11-20T11:42:41.826 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 0, 2020-11-20T11:42:41.827 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T11:42:41.827 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2020-11-20T11:42:41.827 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2020-11-20T11:42:41.827 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2020-11-20T11:42:41.827 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 848, 2020-11-20T11:42:41.828 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 2, 2020-11-20T11:42:41.828 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2020-11-20T11:42:41.828 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2020-11-20T11:42:41.828 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2020-11-20T11:42:41.828 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2020-11-20T11:42:41.829 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2020-11-20T11:42:41.829 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T11:42:41.829 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2020-11-20T11:42:41.829 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2020-11-20T11:42:41.829 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2020-11-20T11:42:41.830 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 207, 2020-11-20T11:42:41.830 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 129252, 2020-11-20T11:42:41.830 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:41.830 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 207, 2020-11-20T11:42:41.830 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2020-11-20T11:42:41.831 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2020-11-20T11:42:41.831 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 207, 2020-11-20T11:42:41.831 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 129252, 2020-11-20T11:42:41.831 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2020-11-20T11:42:41.831 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2020-11-20T11:42:41.832 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2020-11-20T11:42:41.832 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2020-11-20T11:42:41.832 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:42:41.832 INFO:teuthology.orchestra.run.smithi105.stdout: } 2020-11-20T11:42:41.832 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:42:41.833 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2020-11-20T11:42:41.833 DEBUG:tasks.check_counter:Getting stats from b 2020-11-20T11:42:41.834 INFO:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-11-20T11:42:42.643 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:42.592+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 109 slow ops, oldest is osd_op(client.4661.0:57801 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2625536~4096 in=4096b,write 2797568~4096 in=4096b,write 3325952~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:43.668 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:43.624+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 110 slow ops, oldest is osd_op(client.4661.0:57801 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2625536~4096 in=4096b,write 2797568~4096 in=4096b,write 3325952~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:44.654 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:44.630+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 112 slow ops, oldest is osd_op(client.4661.0:57801 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2625536~4096 in=4096b,write 2797568~4096 in=4096b,write 3325952~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:45.675 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:45.630+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 116 slow ops, oldest is osd_op(client.4661.0:57801 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2625536~4096 in=4096b,write 2797568~4096 in=4096b,write 3325952~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:46.730 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:46.685+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 116 slow ops, oldest is osd_op(client.4661.0:57801 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2625536~4096 in=4096b,write 2797568~4096 in=4096b,write 3325952~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:47.730 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:47.662+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 115 slow ops, oldest is osd_op(client.4661.0:58094 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 512000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:48.632 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:48.619+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4661.0:58094 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 512000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:49.722 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:49.679+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 124 slow ops, oldest is osd_op(client.4661.0:58199 4.3s0 4:c319d237:::10000000354.00000000:head [write 765952~4096 in=4096b,write 3309568~4096 in=4096b,write 3899392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:50.781 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:50.712+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 124 slow ops, oldest is osd_op(client.4661.0:58412 4.3s0 4:cb848b31:::10000000368.00000014:head [write 1454080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:51.724 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:51.685+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 123 slow ops, oldest is osd_op(client.4661.0:59015 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:52.798 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:52.749+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 126 slow ops, oldest is osd_op(client.4661.0:59015 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:53.788 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:53.738+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 129 slow ops, oldest is osd_op(client.4661.0:59015 4.3s0 4:cc7b39ba:::1000000034f.00000005:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:54.489 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2020-11-20T11:42:54.489 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T11:42:54.489 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 212, 2020-11-20T11:42:54.490 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 211, 2020-11-20T11:42:54.490 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 160464, 2020-11-20T11:42:54.490 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 115888, 2020-11-20T11:42:54.490 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2020-11-20T11:42:54.490 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 18446744073709551615, 2020-11-20T11:42:54.491 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.027134601, 2020-11-20T11:42:54.491 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.010353812, 2020-11-20T11:42:54.491 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.008539494, 2020-11-20T11:42:54.491 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.004516238, 2020-11-20T11:42:54.492 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:54.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 211, 2020-11-20T11:42:54.492 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011164639, 2020-11-20T11:42:54.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000052912 2020-11-20T11:42:54.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.493 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:54.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2020-11-20T11:42:54.493 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2020-11-20T11:42:54.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2020-11-20T11:42:54.494 INFO:teuthology.orchestra.run.smithi100.stdout: } 2020-11-20T11:42:54.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.494 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T11:42:54.494 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1, 2020-11-20T11:42:54.494 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 164, 2020-11-20T11:42:54.495 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 160, 2020-11-20T11:42:54.495 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 94732, 2020-11-20T11:42:54.495 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2020-11-20T11:42:54.495 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2020-11-20T11:42:54.495 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.010700881, 2020-11-20T11:42:54.496 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.008152977, 2020-11-20T11:42:54.496 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001072448, 2020-11-20T11:42:54.496 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T11:42:54.496 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:54.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2020-11-20T11:42:54.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.015714863, 2020-11-20T11:42:54.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000096410 2020-11-20T11:42:54.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.497 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:54.498 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2020-11-20T11:42:54.498 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2020-11-20T11:42:54.498 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2020-11-20T11:42:54.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2020-11-20T11:42:54.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T11:42:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1, 2020-11-20T11:42:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 3, 2020-11-20T11:42:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 107, 2020-11-20T11:42:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 281, 2020-11-20T11:42:54.500 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2020-11-20T11:42:54.500 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 18446744073709551615, 2020-11-20T11:42:54.500 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000323777, 2020-11-20T11:42:54.500 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000015585, 2020-11-20T11:42:54.500 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000239381, 2020-11-20T11:42:54.501 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T11:42:54.501 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:54.501 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2020-11-20T11:42:54.501 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000263992, 2020-11-20T11:42:54.501 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000131996 2020-11-20T11:42:54.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.502 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:54.502 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2020-11-20T11:42:54.502 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2020-11-20T11:42:54.502 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2020-11-20T11:42:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: } 2020-11-20T11:42:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2020-11-20T11:42:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2020-11-20T11:42:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2020-11-20T11:42:54.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.504 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2020-11-20T11:42:54.504 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2020-11-20T11:42:54.504 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2020-11-20T11:42:54.504 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T11:42:54.505 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2020-11-20T11:42:54.505 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T11:42:54.505 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2020-11-20T11:42:54.505 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T11:42:54.505 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T11:42:54.506 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Buffer_items": 0, 2020-11-20T11:42:54.507 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T11:42:54.507 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Extent_items": 0, 2020-11-20T11:42:54.507 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T11:42:54.507 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_Blob_items": 0, 2020-11-20T11:42:54.507 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2020-11-20T11:42:54.508 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2020-11-20T11:42:54.509 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2020-11-20T11:42:54.509 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T11:42:54.509 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T11:42:54.509 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2020-11-20T11:42:54.510 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2020-11-20T11:42:54.510 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2020-11-20T11:42:54.510 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2020-11-20T11:42:54.510 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T11:42:54.510 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2020-11-20T11:42:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T11:42:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2020-11-20T11:42:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 89650, 2020-11-20T11:42:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 38, 2020-11-20T11:42:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2020-11-20T11:42:54.512 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2020-11-20T11:42:54.512 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2020-11-20T11:42:54.512 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2020-11-20T11:42:54.512 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2020-11-20T11:42:54.513 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2020-11-20T11:42:54.513 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2020-11-20T11:42:54.513 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2020-11-20T11:42:54.513 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2020-11-20T11:42:54.513 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2020-11-20T11:42:54.514 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T11:42:54.514 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2020-11-20T11:42:54.514 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2020-11-20T11:42:54.514 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2020-11-20T11:42:54.514 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 848, 2020-11-20T11:42:54.515 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2020-11-20T11:42:54.515 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2020-11-20T11:42:54.515 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2020-11-20T11:42:54.515 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2020-11-20T11:42:54.515 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2020-11-20T11:42:54.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2020-11-20T11:42:54.516 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T11:42:54.516 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2020-11-20T11:42:54.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2020-11-20T11:42:54.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2020-11-20T11:42:54.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 210, 2020-11-20T11:42:54.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 129642, 2020-11-20T11:42:54.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:54.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 210, 2020-11-20T11:42:54.518 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2020-11-20T11:42:54.518 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2020-11-20T11:42:54.518 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 210, 2020-11-20T11:42:54.518 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 129642, 2020-11-20T11:42:54.518 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2020-11-20T11:42:54.519 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2020-11-20T11:42:54.519 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2020-11-20T11:42:54.519 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2020-11-20T11:42:54.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2020-11-20T11:42:54.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2020-11-20T11:42:54.520 INFO:teuthology.orchestra.run.smithi100.stdout:} 2020-11-20T11:42:54.821 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:54.750+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4661.0:59396 4.3s0 4:d19804d7:::1000000039a.00000001:head [write 2674688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:55.139 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2020-11-20T11:42:55.140 DEBUG:tasks.check_counter:Getting stats from c 2020-11-20T11:42:55.140 INFO:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2020-11-20T11:42:55.810 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:55.760+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 133 slow ops, oldest is osd_op(client.4661.0:59396 4.3s0 4:d19804d7:::1000000039a.00000001:head [write 2674688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:56.862 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:56.804+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 136 slow ops, oldest is osd_op(client.4661.0:59458 4.3s0 4:dad2416e:::100000003c4.00000001:head [write 323584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:57.016 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2020-11-20T11:42:57.016 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T11:42:57.017 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 363, 2020-11-20T11:42:57.017 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 363, 2020-11-20T11:42:57.017 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 245947, 2020-11-20T11:42:57.017 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 267417, 2020-11-20T11:42:57.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 7, 2020-11-20T11:42:57.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2020-11-20T11:42:57.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.233729636, 2020-11-20T11:42:57.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.015051522, 2020-11-20T11:42:57.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.014280428, 2020-11-20T11:42:57.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.201834477, 2020-11-20T11:42:57.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:57.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 362, 2020-11-20T11:42:57.019 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.031940632, 2020-11-20T11:42:57.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000088233 2020-11-20T11:42:57.020 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:57.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.020 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.021 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.021 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T11:42:57.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 5191, 2020-11-20T11:42:57.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 7109, 2020-11-20T11:42:57.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1640651, 2020-11-20T11:42:57.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 3892306, 2020-11-20T11:42:57.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2020-11-20T11:42:57.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 3, 2020-11-20T11:42:57.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.432359986, 2020-11-20T11:42:57.023 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.152788246, 2020-11-20T11:42:57.023 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.278183903, 2020-11-20T11:42:57.023 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.042988733, 2020-11-20T11:42:57.023 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:57.023 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7108, 2020-11-20T11:42:57.024 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.353288592, 2020-11-20T11:42:57.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000049702 2020-11-20T11:42:57.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.024 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:57.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 11184, 2020-11-20T11:42:57.025 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.002027049, 2020-11-20T11:42:57.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000181 2020-11-20T11:42:57.026 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.026 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.026 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T11:42:57.027 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1708, 2020-11-20T11:42:57.027 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 1713, 2020-11-20T11:42:57.027 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 421962, 2020-11-20T11:42:57.027 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 8870123, 2020-11-20T11:42:57.027 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2020-11-20T11:42:57.028 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 3, 2020-11-20T11:42:57.028 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.155676513, 2020-11-20T11:42:57.028 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.052817469, 2020-11-20T11:42:57.028 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.037332194, 2020-11-20T11:42:57.028 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.053417940, 2020-11-20T11:42:57.029 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T11:42:57.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1711, 2020-11-20T11:42:57.029 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.104599169, 2020-11-20T11:42:57.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000061133 2020-11-20T11:42:57.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2020-11-20T11:42:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.031 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2020-11-20T11:42:57.031 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2020-11-20T11:42:57.031 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2020-11-20T11:42:57.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.032 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2020-11-20T11:42:57.032 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2020-11-20T11:42:57.032 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2020-11-20T11:42:57.032 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3127, 2020-11-20T11:42:57.032 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.660492262, 2020-11-20T11:42:57.033 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000531017 2020-11-20T11:42:57.033 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.033 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.033 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2020-11-20T11:42:57.034 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2020-11-20T11:42:57.034 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2020-11-20T11:42:57.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 307, 2020-11-20T11:42:57.034 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.034879816, 2020-11-20T11:42:57.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000113615 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 1267, 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 1267, 2020-11-20T11:42:57.035 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2020-11-20T11:42:57.036 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1267, 2020-11-20T11:42:57.036 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.079602479, 2020-11-20T11:42:57.036 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001641359 2020-11-20T11:42:57.036 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.036 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2020-11-20T11:42:57.037 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch": 0, 2020-11-20T11:42:57.037 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 21, 2020-11-20T11:42:57.037 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 1, 2020-11-20T11:42:57.037 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2020-11-20T11:42:57.037 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 73, 2020-11-20T11:42:57.038 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2020-11-20T11:42:57.038 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 73, 2020-11-20T11:42:57.038 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2020-11-20T11:42:57.038 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 73, 2020-11-20T11:42:57.038 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2020-11-20T11:42:57.039 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 62, 2020-11-20T11:42:57.039 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 62, 2020-11-20T11:42:57.039 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2020-11-20T11:42:57.039 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 1312, 2020-11-20T11:42:57.039 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 1298, 2020-11-20T11:42:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2020-11-20T11:42:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2020-11-20T11:42:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2020-11-20T11:42:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2020-11-20T11:42:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 0, 2020-11-20T11:42:57.041 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 1864, 2020-11-20T11:42:57.041 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2020-11-20T11:42:57.041 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2020-11-20T11:42:57.041 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2020-11-20T11:42:57.041 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2020-11-20T11:42:57.042 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2020-11-20T11:42:57.042 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2020-11-20T11:42:57.042 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2020-11-20T11:42:57.042 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2020-11-20T11:42:57.042 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2020-11-20T11:42:57.043 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2020-11-20T11:42:57.043 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2020-11-20T11:42:57.043 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2020-11-20T11:42:57.043 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 593, 2020-11-20T11:42:57.043 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 2153, 2020-11-20T11:42:57.044 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2020-11-20T11:42:57.044 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2020-11-20T11:42:57.044 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2020-11-20T11:42:57.044 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 2938, 2020-11-20T11:42:57.044 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 1802, 2020-11-20T11:42:57.045 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 13, 2020-11-20T11:42:57.045 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 1458 2020-11-20T11:42:57.045 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.045 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2020-11-20T11:42:57.045 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 62, 2020-11-20T11:42:57.046 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2020-11-20T11:42:57.046 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 1, 2020-11-20T11:42:57.046 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 470, 2020-11-20T11:42:57.046 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 408, 2020-11-20T11:42:57.046 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 0, 2020-11-20T11:42:57.047 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2020-11-20T11:42:57.047 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2020-11-20T11:42:57.047 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2020-11-20T11:42:57.047 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2020-11-20T11:42:57.047 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2020-11-20T11:42:57.048 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2020-11-20T11:42:57.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2020-11-20T11:42:57.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2020-11-20T11:42:57.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2020-11-20T11:42:57.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 1, 2020-11-20T11:42:57.049 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2020-11-20T11:42:57.049 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2020-11-20T11:42:57.049 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.049 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2020-11-20T11:42:57.049 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 3806, 2020-11-20T11:42:57.050 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2020-11-20T11:42:57.050 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2020-11-20T11:42:57.050 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 3806, 2020-11-20T11:42:57.050 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2020-11-20T11:42:57.050 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2020-11-20T11:42:57.051 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 5, 2020-11-20T11:42:57.051 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2020-11-20T11:42:57.051 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2020-11-20T11:42:57.051 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 5, 2020-11-20T11:42:57.051 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2020-11-20T11:42:57.052 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2020-11-20T11:42:57.052 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2020-11-20T11:42:57.052 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 12772315, 2020-11-20T11:42:57.052 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2020-11-20T11:42:57.052 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2020-11-20T11:42:57.053 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1504, 2020-11-20T11:42:57.053 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 6.069121287, 2020-11-20T11:42:57.053 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004035320 2020-11-20T11:42:57.053 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.053 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2020-11-20T11:42:57.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.054 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2020-11-20T11:42:57.054 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 75, 2020-11-20T11:42:57.054 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 483, 2020-11-20T11:42:57.054 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 408, 2020-11-20T11:42:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 12, 2020-11-20T11:42:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 34, 2020-11-20T11:42:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 22, 2020-11-20T11:42:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 73, 2020-11-20T11:42:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 785, 2020-11-20T11:42:57.056 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 712, 2020-11-20T11:42:57.056 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 62, 2020-11-20T11:42:57.056 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 471, 2020-11-20T11:42:57.056 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 409, 2020-11-20T11:42:57.056 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 53540, 2020-11-20T11:42:57.057 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 340188 2020-11-20T11:42:57.057 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.057 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2020-11-20T11:42:57.057 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 1383, 2020-11-20T11:42:57.057 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2020-11-20T11:42:57.058 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 1267, 2020-11-20T11:42:57.058 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 10, 2020-11-20T11:42:57.058 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2020-11-20T11:42:57.058 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2020-11-20T11:42:57.058 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 452, 2020-11-20T11:42:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.404827973, 2020-11-20T11:42:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000895637 2020-11-20T11:42:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2020-11-20T11:42:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7, 2020-11-20T11:42:57.060 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001850497, 2020-11-20T11:42:57.060 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000264356 2020-11-20T11:42:57.060 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.060 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2020-11-20T11:42:57.060 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.061 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.061 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.061 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.061 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2020-11-20T11:42:57.061 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.062 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.062 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.062 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2020-11-20T11:42:57.062 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000714521, 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000357260 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.063 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.064 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.064 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2020-11-20T11:42:57.064 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.064 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.065 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.065 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.065 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2020-11-20T11:42:57.065 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.065 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.066 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.066 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2020-11-20T11:42:57.066 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.066 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.067 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.067 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2020-11-20T11:42:57.067 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.067 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.068 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.068 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.068 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2020-11-20T11:42:57.068 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.068 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.069 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.069 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2020-11-20T11:42:57.069 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 14, 2020-11-20T11:42:57.069 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.024408239, 2020-11-20T11:42:57.070 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001743445 2020-11-20T11:42:57.070 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.070 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2020-11-20T11:42:57.070 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.070 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2020-11-20T11:42:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.072 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.072 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2020-11-20T11:42:57.072 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 250, 2020-11-20T11:42:57.072 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.455579653, 2020-11-20T11:42:57.073 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001822318 2020-11-20T11:42:57.073 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.073 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2020-11-20T11:42:57.073 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 64, 2020-11-20T11:42:57.073 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.407371314, 2020-11-20T11:42:57.074 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.006365176 2020-11-20T11:42:57.074 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.074 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2020-11-20T11:42:57.074 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 22, 2020-11-20T11:42:57.074 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.043805285, 2020-11-20T11:42:57.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001991149 2020-11-20T11:42:57.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.075 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2020-11-20T11:42:57.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.075 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.076 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.076 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.076 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2020-11-20T11:42:57.076 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 14, 2020-11-20T11:42:57.076 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.213286703, 2020-11-20T11:42:57.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.015234764 2020-11-20T11:42:57.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.077 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2020-11-20T11:42:57.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.077 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.078 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2020-11-20T11:42:57.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.078 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.079 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.079 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2020-11-20T11:42:57.079 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2020-11-20T11:42:57.079 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000492251, 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000492251 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.081 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2020-11-20T11:42:57.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.081 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.082 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2020-11-20T11:42:57.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.082 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.083 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2020-11-20T11:42:57.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.083 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.084 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2020-11-20T11:42:57.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 4, 2020-11-20T11:42:57.084 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003266537, 2020-11-20T11:42:57.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000816634 2020-11-20T11:42:57.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.085 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2020-11-20T11:42:57.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 437, 2020-11-20T11:42:57.085 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.523999506, 2020-11-20T11:42:57.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001199083 2020-11-20T11:42:57.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.086 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2020-11-20T11:42:57.086 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0 2020-11-20T11:42:57.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.086 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2020-11-20T11:42:57.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2020-11-20T11:42:57.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2020-11-20T11:42:57.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 0, 2020-11-20T11:42:57.087 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2020-11-20T11:42:57.087 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2020-11-20T11:42:57.088 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 267, 2020-11-20T11:42:57.088 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 267, 2020-11-20T11:42:57.088 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 783 2020-11-20T11:42:57.088 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.088 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2020-11-20T11:42:57.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2020-11-20T11:42:57.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2020-11-20T11:42:57.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T11:42:57.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2020-11-20T11:42:57.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T11:42:57.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2020-11-20T11:42:57.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T11:42:57.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T11:42:57.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Buffer_items": 0, 2020-11-20T11:42:57.091 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T11:42:57.092 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Extent_items": 0, 2020-11-20T11:42:57.092 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T11:42:57.092 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_Blob_items": 0, 2020-11-20T11:42:57.092 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T11:42:57.092 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T11:42:57.093 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T11:42:57.093 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T11:42:57.093 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T11:42:57.093 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2020-11-20T11:42:57.094 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2020-11-20T11:42:57.094 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2020-11-20T11:42:57.094 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T11:42:57.094 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T11:42:57.094 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2020-11-20T11:42:57.095 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2020-11-20T11:42:57.095 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2020-11-20T11:42:57.095 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2020-11-20T11:42:57.095 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T11:42:57.095 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2020-11-20T11:42:57.096 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T11:42:57.096 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2020-11-20T11:42:57.096 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 208639, 2020-11-20T11:42:57.096 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 104, 2020-11-20T11:42:57.099 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 88, 2020-11-20T11:42:57.099 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 1, 2020-11-20T11:42:57.099 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2020-11-20T11:42:57.100 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2020-11-20T11:42:57.100 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2020-11-20T11:42:57.100 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2020-11-20T11:42:57.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2020-11-20T11:42:57.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2020-11-20T11:42:57.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 6696, 2020-11-20T11:42:57.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 115, 2020-11-20T11:42:57.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T11:42:57.102 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2020-11-20T11:42:57.102 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2020-11-20T11:42:57.102 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2020-11-20T11:42:57.102 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 246820, 2020-11-20T11:42:57.102 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 3715, 2020-11-20T11:42:57.103 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2020-11-20T11:42:57.103 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2020-11-20T11:42:57.103 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2020-11-20T11:42:57.103 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2020-11-20T11:42:57.103 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.104 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2020-11-20T11:42:57.104 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 4, 2020-11-20T11:42:57.104 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 4, 2020-11-20T11:42:57.104 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 1998, 2020-11-20T11:42:57.104 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 8780544, 2020-11-20T11:42:57.105 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 36, 2020-11-20T11:42:57.105 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 1994, 2020-11-20T11:42:57.105 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2020-11-20T11:42:57.105 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1998, 2020-11-20T11:42:57.105 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2208 2020-11-20T11:42:57.106 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.106 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 1998, 2020-11-20T11:42:57.106 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 16, 2020-11-20T11:42:57.106 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 1982, 2020-11-20T11:42:57.106 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2020-11-20T11:42:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2020-11-20T11:42:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2020-11-20T11:42:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 10, 2020-11-20T11:42:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 16, 2020-11-20T11:42:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 1524, 2020-11-20T11:42:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 63, 2020-11-20T11:42:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2020-11-20T11:42:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2020-11-20T11:42:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2020-11-20T11:42:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 1, 2020-11-20T11:42:57.109 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 256, 2020-11-20T11:42:57.109 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2020-11-20T11:42:57.109 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2020-11-20T11:42:57.109 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2020-11-20T11:42:57.109 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2020-11-20T11:42:57.110 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 20, 2020-11-20T11:42:57.110 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2020-11-20T11:42:57.110 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2020-11-20T11:42:57.110 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2020-11-20T11:42:57.110 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2020-11-20T11:42:57.111 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2020-11-20T11:42:57.111 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2020-11-20T11:42:57.111 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2020-11-20T11:42:57.111 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2020-11-20T11:42:57.111 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2020-11-20T11:42:57.112 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2020-11-20T11:42:57.112 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2020-11-20T11:42:57.112 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2020-11-20T11:42:57.112 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2020-11-20T11:42:57.112 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2020-11-20T11:42:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2020-11-20T11:42:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2020-11-20T11:42:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2020-11-20T11:42:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2020-11-20T11:42:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2020-11-20T11:42:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2020-11-20T11:42:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2020-11-20T11:42:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2020-11-20T11:42:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2020-11-20T11:42:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2020-11-20T11:42:57.115 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2020-11-20T11:42:57.115 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2020-11-20T11:42:57.115 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 0, 2020-11-20T11:42:57.115 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2020-11-20T11:42:57.116 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 0, 2020-11-20T11:42:57.117 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 9, 2020-11-20T11:42:57.117 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 9, 2020-11-20T11:42:57.117 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2020-11-20T11:42:57.118 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 2, 2020-11-20T11:42:57.118 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 241, 2020-11-20T11:42:57.119 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2020-11-20T11:42:57.119 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 77 2020-11-20T11:42:57.119 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.120 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2020-11-20T11:42:57.120 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2020-11-20T11:42:57.120 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2020-11-20T11:42:57.120 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2020-11-20T11:42:57.121 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2020-11-20T11:42:57.121 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.121 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2020-11-20T11:42:57.122 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 4, 2020-11-20T11:42:57.122 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 4, 2020-11-20T11:42:57.122 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 4, 2020-11-20T11:42:57.123 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 4, 2020-11-20T11:42:57.123 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 238, 2020-11-20T11:42:57.123 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 169 2020-11-20T11:42:57.124 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.124 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T11:42:57.124 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2020-11-20T11:42:57.125 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2020-11-20T11:42:57.125 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2020-11-20T11:42:57.125 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 7258, 2020-11-20T11:42:57.126 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 1641015, 2020-11-20T11:42:57.126 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:57.126 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 7258, 2020-11-20T11:42:57.127 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2020-11-20T11:42:57.127 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2020-11-20T11:42:57.127 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 7258, 2020-11-20T11:42:57.128 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 1641015, 2020-11-20T11:42:57.128 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2020-11-20T11:42:57.128 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.128 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.129 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.129 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.129 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.130 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2020-11-20T11:42:57.130 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2020-11-20T11:42:57.130 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2020-11-20T11:42:57.131 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2020-11-20T11:42:57.131 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2020-11-20T11:42:57.131 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2020-11-20T11:42:57.132 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:57.132 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2020-11-20T11:42:57.132 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 1998, 2020-11-20T11:42:57.133 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 8821154, 2020-11-20T11:42:57.133 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 1741, 2020-11-20T11:42:57.133 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 8821154, 2020-11-20T11:42:57.134 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2020-11-20T11:42:57.134 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.134 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.135 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.135 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.135 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.136 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2020-11-20T11:42:57.136 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 4, 2020-11-20T11:42:57.136 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2020-11-20T11:42:57.137 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2020-11-20T11:42:57.137 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2020-11-20T11:42:57.137 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2020-11-20T11:42:57.138 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:57.138 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2020-11-20T11:42:57.138 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 1998, 2020-11-20T11:42:57.139 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 1998, 2020-11-20T11:42:57.139 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 1994, 2020-11-20T11:42:57.139 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 1994, 2020-11-20T11:42:57.140 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2020-11-20T11:42:57.140 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.140 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.140 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.141 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.141 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.141 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2020-11-20T11:42:57.142 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 101, 2020-11-20T11:42:57.142 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2020-11-20T11:42:57.142 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2020-11-20T11:42:57.143 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 409, 2020-11-20T11:42:57.143 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 41317, 2020-11-20T11:42:57.143 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:57.144 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 409, 2020-11-20T11:42:57.144 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2020-11-20T11:42:57.144 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2020-11-20T11:42:57.145 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 20, 2020-11-20T11:42:57.145 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 41216, 2020-11-20T11:42:57.146 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2020-11-20T11:42:57.146 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.146 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.147 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.147 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.147 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2020-11-20T11:42:57.147 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x5610c77cbf40": { 2020-11-20T11:42:57.148 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2020-11-20T11:42:57.148 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2020-11-20T11:42:57.148 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2020-11-20T11:42:57.149 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 3806, 2020-11-20T11:42:57.149 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 8578011, 2020-11-20T11:42:57.150 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2020-11-20T11:42:57.150 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 3806, 2020-11-20T11:42:57.150 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2020-11-20T11:42:57.151 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2020-11-20T11:42:57.151 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 1504, 2020-11-20T11:42:57.151 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 8578011, 2020-11-20T11:42:57.151 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2020-11-20T11:42:57.152 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2020-11-20T11:42:57.152 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2020-11-20T11:42:57.152 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2020-11-20T11:42:57.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2020-11-20T11:42:57.153 INFO:teuthology.orchestra.run.smithi067.stdout:} 2020-11-20T11:42:57.155 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=1 2020-11-20T11:42:57.156 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-11-20T11:42:57.171 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-11-20T11:42:57.172 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi105.front.sepia.ceph.com... 2020-11-20T11:42:57.172 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T11:42:57.173 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:42:57.246 INFO:teuthology.orchestra.run:waiting for 900 2020-11-20T11:42:57.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi105.stderr:ceph-fuse[30372]: fuse finished with error 0 and tester_r 0 2020-11-20T11:42:57.843 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:57.795+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 136 slow ops, oldest is osd_op(client.4661.0:59688 4.3s0 4:cff79f6e:::10000000354.00000010:head [write 258048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:58.904 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:58.845+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 134 slow ops, oldest is osd_op(client.4661.0:59744 4.3s0 4:dbee96d5:::10000000354.00000005:head [write 2482176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:42:59.894 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:42:59.823+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 136 slow ops, oldest is osd_op(client.4661.0:59910 4.3s0 4:cc36563d:::100000003bf.00000004:head [write 1249280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:00.882 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:00.879+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 136 slow ops, oldest is osd_op(client.4661.0:60863 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:01.945 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:01.921+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 139 slow ops, oldest is osd_op(client.4661.0:60863 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:02.983 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:02.913+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 138 slow ops, oldest is osd_op(client.4661.0:60863 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:03.994 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:03.944+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 139 slow ops, oldest is osd_op(client.4661.0:60863 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:05.038 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:04.996+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 142 slow ops, oldest is osd_op(client.4661.0:60863 4.3s0 4:d85afd5e:::100000003c9.00000010:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:06.025 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:05.986+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4661.0:61281 4.3s0 4:d7d588ed:::10000000399.00000009:head [write 2621440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:07.003 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:06.966+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 143 slow ops, oldest is osd_op(client.4661.0:61281 4.3s0 4:d7d588ed:::10000000399.00000009:head [write 2621440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:08.022 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:07.973+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 142 slow ops, oldest is osd_op(client.4661.0:61473 4.3s0 4:d76f23c4:::10000000384.0000000c:head [write 3481600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:08.992 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:08.958+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 141 slow ops, oldest is osd_op(client.4661.0:61787 4.3s0 4:d07e89d5:::10000000378.00000017:head [write 425984~4096 in=4096b,write 995328~4096 in=4096b,write 3620864~4096 in=4096b,write 3780608~4096 in=4096b,write 4079616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:10.033 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:09.988+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 143 slow ops, oldest is osd_op(client.4661.0:62030 4.3s0 4:d5177217:::1000000035f.00000013:head [write 4059136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:11.034 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:11.004+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 142 slow ops, oldest is osd_op(client.4661.0:62956 4.3s0 4:d31d5760:::1000000039a.00000014:head [write 1769472~4096 in=4096b,write 3231744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:12.050 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:12.046+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 146 slow ops, oldest is osd_op(client.4661.0:62956 4.3s0 4:d31d5760:::1000000039a.00000014:head [write 1769472~4096 in=4096b,write 3231744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:13.084 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:13.058+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 145 slow ops, oldest is osd_op(client.4661.0:62956 4.3s0 4:d31d5760:::1000000039a.00000014:head [write 1769472~4096 in=4096b,write 3231744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:14.050 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:14.017+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 149 slow ops, oldest is osd_op(client.4661.0:62956 4.3s0 4:d31d5760:::1000000039a.00000014:head [write 1769472~4096 in=4096b,write 3231744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:15.092 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:15.060+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 147 slow ops, oldest is osd_op(client.4661.0:63411 4.3s0 4:c5b24d84:::10000000354.00000001:head [write 3522560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:16.107 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:16.047+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 147 slow ops, oldest is osd_op(client.4661.0:63411 4.3s0 4:c5b24d84:::10000000354.00000001:head [write 3522560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:17.136 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:17.094+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 150 slow ops, oldest is osd_op(client.4661.0:63805 4.3s0 4:dbc1afc3:::100000003ba.00000004:head [write 2629632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:18.147 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:18.114+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 149 slow ops, oldest is osd_op(client.4661.0:63970 4.3s0 4:dfe62cd8:::10000000355.00000002:head [write 1421312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:19.157 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:19.123+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 148 slow ops, oldest is osd_op(client.4661.0:64529 4.3s0 4:dbf51981:::10000000355.00000008:head [write 184320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:20.202 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:20.173+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 152 slow ops, oldest is osd_op(client.4661.0:64529 4.3s0 4:dbf51981:::10000000355.00000008:head [write 184320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:21.197 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:21.165+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 153 slow ops, oldest is osd_op(client.4661.0:64736 4.3s0 4:c117460b:::100000003b0.00000011:head [write 3219456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:22.213 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:22.171+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 155 slow ops, oldest is osd_op(client.4661.0:64828 4.3s0 4:dbf51981:::10000000355.00000008:head [write 2572288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:23.249 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:23.217+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 158 slow ops, oldest is osd_op(client.4661.0:65385 4.3s0 4:c33d622e:::100000003af.00000009:head [write 909312~4096 in=4096b,write 1409024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:24.267 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:24.225+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:65426 4.3s0 4:ca058b97:::100000003b0.0000000b:head [write 1392640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:25.284 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:25.246+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 159 slow ops, oldest is osd_op(client.4661.0:65862 4.3s0 4:d7404747:::1000000034d.00000000:head [write 1929216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:26.276 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:26.256+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 162 slow ops, oldest is osd_op(client.4661.0:66051 4.3s0 4:d4a96106:::10000000357.00000004:head [write 299008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:27.342 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:27.307+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 160 slow ops, oldest is osd_op(client.4661.0:66295 4.3s0 4:ca058b97:::100000003b0.0000000b:head [write 233472~4096 in=4096b,write 700416~4096 in=4096b,write 864256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:28.351 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:28.347+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 162 slow ops, oldest is osd_op(client.4661.0:66295 4.3s0 4:ca058b97:::100000003b0.0000000b:head [write 233472~4096 in=4096b,write 700416~4096 in=4096b,write 864256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:29.391 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:29.345+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 162 slow ops, oldest is osd_op(client.4661.0:66753 4.3s0 4:cb8c0826:::10000000367.00000012:head [write 520192~4096 in=4096b,write 1081344~4096 in=4096b,write 4001792~4096 in=4096b,write 4087808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:30.387 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:30.342+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 167 slow ops, oldest is osd_op(client.4661.0:66753 4.3s0 4:cb8c0826:::10000000367.00000012:head [write 520192~4096 in=4096b,write 1081344~4096 in=4096b,write 4001792~4096 in=4096b,write 4087808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:31.433 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:31.385+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 164 slow ops, oldest is osd_op(client.4661.0:66918 4.3s0 4:cb848b31:::10000000368.00000014:head [write 3530752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:32.441 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:32.422+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 160 slow ops, oldest is osd_op(client.4661.0:67348 4.3s0 4:d77bdc67:::10000000384.00000017:head [write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:33.413 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:33.385+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 160 slow ops, oldest is osd_op(client.4661.0:67348 4.3s0 4:d77bdc67:::10000000384.00000017:head [write 3997696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:34.400 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:34.342+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 160 slow ops, oldest is osd_op(client.4661.0:67586 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 2371584~4096 in=4096b,write 3301376~4096 in=4096b,write 3801088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:35.334 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:35.317+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 159 slow ops, oldest is osd_op(client.4661.0:67920 4.3s0 4:dbfdefa3:::1000000034d.00000005:head [write 3346432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:36.343 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:36.320+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 159 slow ops, oldest is osd_op(client.4661.0:67956 4.3s0 4:d614468c:::10000000384.0000000f:head [write 1794048~4096 in=4096b,write 3477504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:37.389 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:37.371+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:68461 4.3s0 4:db4accfa:::1000000036f.00000006:head [write 1081344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:38.477 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:38.427+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 155 slow ops, oldest is osd_op(client.4661.0:68773 4.3s0 4:c8bdd65e:::10000000356.00000009:head [write 2199552~4096 in=4096b,write 2965504~4096 in=4096b,write 3485696~4096 in=4096b,write 3641344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:39.445 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:39.413+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 155 slow ops, oldest is osd_op(client.4661.0:69036 4.3s0 4:cb848b31:::10000000368.00000014:head [write 434176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:40.429 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:40.382+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:69036 4.3s0 4:cb848b31:::10000000368.00000014:head [write 434176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:41.384 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:41.346+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:69587 4.3s0 4:c078f235:::1000000037b.0000000b:head [write 2174976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:42.377 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:42.328+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:69587 4.3s0 4:c078f235:::1000000037b.0000000b:head [write 2174976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:43.353 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:43.318+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 160 slow ops, oldest is osd_op(client.4661.0:69745 4.3s0 4:df27832b:::10000000395.00000007:head [write 1257472~4096 in=4096b,write 1458176~4096 in=4096b,write 1720320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:44.427 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:44.408+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:70568 4.3s0 4:de3e3072:::10000000356.00000007:head [write 2187264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:45.419 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:45.400+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:70568 4.3s0 4:de3e3072:::10000000356.00000007:head [write 2187264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:46.466 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:46.431+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:70568 4.3s0 4:de3e3072:::10000000356.00000007:head [write 2187264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:47.434 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:47.403+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:71044 4.3s0 4:c68831a4:::1000000035f.0000000c:head [write 98304~4096 in=4096b,write 1495040~4096 in=4096b,write 1564672~4096 in=4096b,write 3637248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:48.493 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:48.454+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 159 slow ops, oldest is osd_op(client.4661.0:71044 4.3s0 4:c68831a4:::1000000035f.0000000c:head [write 98304~4096 in=4096b,write 1495040~4096 in=4096b,write 1564672~4096 in=4096b,write 3637248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:49.511 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:49.478+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:71593 4.3s0 4:c33d622e:::100000003af.00000009:head [write 1519616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:50.510 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:50.490+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:71593 4.3s0 4:c33d622e:::100000003af.00000009:head [write 1519616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:51.577 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:51.524+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 155 slow ops, oldest is osd_op(client.4661.0:71928 4.3s0 4:c8bdd65e:::10000000356.00000009:head [write 421888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:52.570 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:52.525+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 153 slow ops, oldest is osd_op(client.4661.0:72114 4.3s0 4:c319d237:::10000000354.00000000:head [write 1417216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:53.571 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:53.540+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 151 slow ops, oldest is osd_op(client.4661.0:72319 4.3s0 4:c68962e5:::10000000354.00000007:head [write 1392640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:54.550 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:54.508+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 153 slow ops, oldest is osd_op(client.4661.0:72566 4.3s0 4:dfa56712:::10000000364.00000016:head [write 3207168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:55.536 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:55.489+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:73544 4.3s0 4:d6e7cda5:::10000000369.00000004:head [write 1097728~4096 in=4096b,write 1835008~4096 in=4096b,write 2654208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:56.569 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:56.549+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 158 slow ops, oldest is osd_op(client.4661.0:73544 4.3s0 4:d6e7cda5:::10000000369.00000004:head [write 1097728~4096 in=4096b,write 1835008~4096 in=4096b,write 2654208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:57.589 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:57.553+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:73544 4.3s0 4:d6e7cda5:::10000000369.00000004:head [write 1097728~4096 in=4096b,write 1835008~4096 in=4096b,write 2654208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:58.612 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:58.573+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:73544 4.3s0 4:d6e7cda5:::10000000369.00000004:head [write 1097728~4096 in=4096b,write 1835008~4096 in=4096b,write 2654208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:43:59.591 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:43:59.536+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:73698 4.3s0 4:c2ffa393:::10000000379.0000000a:head [write 2756608~4096 in=4096b,write 3465216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:00.579 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:00.550+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:74911 4.3s0 4:d1f9ee67:::1000000035d.00000015:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:01.605 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:01.583+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:74911 4.3s0 4:d1f9ee67:::1000000035d.00000015:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:02.650 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:02.627+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:74911 4.3s0 4:d1f9ee67:::1000000035d.00000015:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:03.709 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:03.671+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 161 slow ops, oldest is osd_op(client.4661.0:74911 4.3s0 4:d1f9ee67:::1000000035d.00000015:head [write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:04.739 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:04.705+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 163 slow ops, oldest is osd_op(client.4661.0:75918 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 782336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:05.778 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:05.736+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 163 slow ops, oldest is osd_op(client.4661.0:75918 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 782336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:06.749 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:06.727+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 163 slow ops, oldest is osd_op(client.4661.0:75918 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 782336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:07.759 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:07.725+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 165 slow ops, oldest is osd_op(client.4661.0:76176 4.3s0 4:dbee96d5:::10000000354.00000005:head [write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:08.748 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:08.696+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 169 slow ops, oldest is osd_op(client.4661.0:76297 4.3s0 4:c57b8a31:::10000000356.0000000a:head [write 12288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:09.733 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:09.696+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 166 slow ops, oldest is osd_op(client.4661.0:76578 4.3s0 4:d5177217:::1000000035f.00000013:head [write 3284992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:10.784 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:10.735+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 164 slow ops, oldest is osd_op(client.4661.0:76762 4.3s0 4:c1fae430:::1000000037c.00000003:head [write 2744320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:11.787 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:11.767+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 162 slow ops, oldest is osd_op(client.4661.0:77162 4.3s0 4:d4d2c4f1:::1000000034d.0000000c:head [write 2637824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:12.893 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:12.872+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 165 slow ops, oldest is osd_op(client.4661.0:77473 4.3s0 4:de41c339:::100000003b0.00000007:head [write 753664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:13.885 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:13.830+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 164 slow ops, oldest is osd_op(client.4661.0:77473 4.3s0 4:de41c339:::100000003b0.00000007:head [write 753664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:14.930 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:14.885+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 162 slow ops, oldest is osd_op(client.4661.0:77789 4.3s0 4:c3d6fb42:::10000000365.0000000b:head [write 1880064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:15.959 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:15.921+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 161 slow ops, oldest is osd_op(client.4661.0:77958 4.3s0 4:dfa56712:::10000000364.00000016:head [write 2871296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:16.990 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:16.957+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 158 slow ops, oldest is osd_op(client.4661.0:78262 4.3s0 4:c58a4e67:::10000000379.00000002:head [write 1200128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:18.045 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:18.001+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:78517 4.3s0 4:cfe2244e:::10000000380.0000000b:head [write 2195456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:19.039 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:19.018+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:79002 4.3s0 4:da3486cc:::1000000039b.00000000:head [write 1474560~4096 in=4096b,write 1753088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:20.031 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:20.001+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 153 slow ops, oldest is osd_op(client.4661.0:79382 4.3s0 4:ca1b42ce:::100000003c8.0000000b:head [write 98304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:21.043 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:21.020+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 155 slow ops, oldest is osd_op(client.4661.0:79382 4.3s0 4:ca1b42ce:::100000003c8.0000000b:head [write 98304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:22.045 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:22.010+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 154 slow ops, oldest is osd_op(client.4661.0:79737 4.3s0 4:dd2d2add:::100000003b0.00000005:head [write 2203648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:23.007 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:22.970+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:80042 4.3s0 4:cb848b31:::10000000368.00000014:head [write 3940352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:23.980 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:23.952+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 157 slow ops, oldest is osd_op(client.4661.0:80197 4.3s0 4:cc75884d:::10000000384.00000003:head [write 3428352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:24.970 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:24.934+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4661.0:80457 4.3s0 4:d6d4c0df:::10000000380.00000014:head [write 1974272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:25.976 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:25.951+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 151 slow ops, oldest is osd_op(client.4661.0:80914 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 724992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:27.020 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:26.985+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 149 slow ops, oldest is osd_op(client.4661.0:81517 4.3s0 4:c920dbfc:::10000000384.0000000d:head [write 1875968~4096 in=4096b,write 2285568~4096 in=4096b,write 2408448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:28.011 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:27.975+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 151 slow ops, oldest is osd_op(client.4661.0:81517 4.3s0 4:c920dbfc:::10000000384.0000000d:head [write 1875968~4096 in=4096b,write 2285568~4096 in=4096b,write 2408448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:29.017 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:28.969+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 151 slow ops, oldest is osd_op(client.4661.0:81517 4.3s0 4:c920dbfc:::10000000384.0000000d:head [write 1875968~4096 in=4096b,write 2285568~4096 in=4096b,write 2408448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:30.006 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:29.983+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 151 slow ops, oldest is osd_op(client.4661.0:81902 4.3s0 4:c68831a4:::1000000035f.0000000c:head [write 307200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:31.038 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:30.998+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 150 slow ops, oldest is osd_op(client.4661.0:82369 4.3s0 4:c920dbfc:::10000000384.0000000d:head [write 823296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:32.023 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:31.981+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 147 slow ops, oldest is osd_op(client.4661.0:82676 4.3s0 4:ca058b97:::100000003b0.0000000b:head [write 1560576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:33.095 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:33.046+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 146 slow ops, oldest is osd_op(client.4661.0:82676 4.3s0 4:ca058b97:::100000003b0.0000000b:head [write 1560576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:34.136 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:34.114+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4661.0:82912 4.3s0 4:c0c9ae65:::10000000384.00000018:head [write 2879488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:35.140 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:35.119+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 145 slow ops, oldest is osd_op(client.4661.0:83910 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 4116480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:36.120 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:36.089+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 146 slow ops, oldest is osd_op(client.4661.0:83910 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 4116480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:37.129 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:37.110+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4661.0:83910 4.3s0 4:c9729b63:::100000003c9.0000000c:head [write 4116480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:38.176 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:38.136+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 143 slow ops, oldest is osd_op(client.4661.0:84005 4.3s0 4:cab26236:::1000000035d.00000018:head [write 2564096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:39.165 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:39.160+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 141 slow ops, oldest is osd_op(client.4661.0:84282 4.3s0 4:cb737d1e:::1000000037b.0000000e:head [write 962560~4096 in=4096b,write 3219456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:40.175 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:40.147+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 138 slow ops, oldest is osd_op(client.4661.0:85030 4.3s0 4:c68962e5:::10000000354.00000007:head [write 3592192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:41.177 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:41.151+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 138 slow ops, oldest is osd_op(client.4661.0:85030 4.3s0 4:c68962e5:::10000000354.00000007:head [write 3592192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:42.228 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:42.184+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 137 slow ops, oldest is osd_op(client.4661.0:85391 4.3s0 4:d059e93c:::10000000384.00000004:head [write 1339392~4096 in=4096b,write 3317760~4096 in=4096b,write 4059136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:43.203 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:43.166+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 135 slow ops, oldest is osd_op(client.4661.0:85588 4.3s0 4:c44851a4:::100000003b8.00000006:head [write 2678784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:44.176 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:44.146+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 131 slow ops, oldest is osd_op(client.4661.0:86100 4.3s0 4:c2ffa393:::10000000379.0000000a:head [write 540672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:45.199 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:45.164+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 131 slow ops, oldest is osd_op(client.4661.0:86605 4.3s0 4:c627dfb8:::100000003b8.00000009:head [write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:46.243 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:46.202+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 129 slow ops, oldest is osd_op(client.4661.0:86605 4.3s0 4:c627dfb8:::100000003b8.00000009:head [write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:47.233 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:47.171+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 130 slow ops, oldest is osd_op(client.4661.0:86605 4.3s0 4:c627dfb8:::100000003b8.00000009:head [write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:48.191 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:48.154+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 129 slow ops, oldest is osd_op(client.4661.0:86851 4.3s0 4:c493171c:::10000000368.00000002:head [write 1589248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:49.166 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:49.132+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 127 slow ops, oldest is osd_op(client.4661.0:87199 4.3s0 4:ca93a1f1:::10000000392.00000014:head [write 3260416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:50.178 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:50.127+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 122 slow ops, oldest is osd_op(client.4661.0:87546 4.3s0 4:cdbcd030:::10000000373.00000018:head [write 3739648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:51.161 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:51.119+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 124 slow ops, oldest is osd_op(client.4661.0:87946 4.3s0 4:de41c339:::100000003b0.00000007:head [write 348160~4096 in=4096b,write 1933312~4096 in=4096b,write 2908160~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:52.157 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:52.151+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 123 slow ops, oldest is osd_op(client.4661.0:87946 4.3s0 4:de41c339:::100000003b0.00000007:head [write 348160~4096 in=4096b,write 1933312~4096 in=4096b,write 2908160~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:53.215 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:53.176+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 119 slow ops, oldest is osd_op(client.4661.0:88693 4.3s0 4:c2e6c6e8:::1000000036b.00000003:head [write 3346432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:54.198 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:54.155+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 119 slow ops, oldest is osd_op(client.4661.0:88693 4.3s0 4:c2e6c6e8:::1000000036b.00000003:head [write 3346432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:55.201 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:55.166+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 118 slow ops, oldest is osd_op(client.4661.0:88919 4.3s0 4:c24bd8c4:::1000000035f.00000014:head [write 2453504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:56.207 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:56.185+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 113 slow ops, oldest is osd_op(client.4661.0:89150 4.3s0 4:c7861165:::10000000392.00000005:head [write 405504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:57.237 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:57.201+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 112 slow ops, oldest is osd_op(client.4661.0:89523 4.3s0 4:c40e4f2f:::10000000368.00000011:head [write 2260992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:58.205 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:58.167+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 109 slow ops, oldest is osd_op(client.4661.0:89760 4.3s0 4:c1c7e07c:::10000000382.00000001:head [write 77824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:44:59.235 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:44:59.191+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 105 slow ops, oldest is osd_op(client.4661.0:89882 4.3s0 4:c1179e34:::10000000354.0000000c:head [write 491520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:00.245 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:00.204+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 104 slow ops, oldest is osd_op(client.4661.0:90133 4.3s0 4:c1c7e07c:::10000000382.00000001:head [write 3067904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:01.222 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:01.187+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 103 slow ops, oldest is osd_op(client.4661.0:90468 4.3s0 4:db32ec29:::1000000035c.00000008:head [write 188416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:02.195 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:02.174+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 100 slow ops, oldest is osd_op(client.4661.0:90820 4.3s0 4:cf08c5b2:::10000000363.00000013:head [write 1482752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:03.200 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:03.179+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 101 slow ops, oldest is osd_op(client.4661.0:91071 4.3s0 4:cd00937e:::10000000373.00000000:head [write 3735552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:04.205 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:04.180+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 99 slow ops, oldest is osd_op(client.4661.0:91474 4.3s0 4:c1179e34:::10000000354.0000000c:head [write 499712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:05.204 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:05.180+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 100 slow ops, oldest is osd_op(client.4661.0:91555 4.3s0 4:ce2836d5:::1000000034a.00000002:head [write 2764800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:06.174 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:06.151+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 99 slow ops, oldest is osd_op(client.4661.0:91867 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 2105344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:07.203 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:07.169+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 98 slow ops, oldest is osd_op(client.4661.0:92507 4.3s0 4:ca7a293c:::10000000351.00000016:head [write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:08.173 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:08.153+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 98 slow ops, oldest is osd_op(client.4661.0:92507 4.3s0 4:ca7a293c:::10000000351.00000016:head [write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:09.224 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:09.202+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4661.0:92931 4.3s0 4:c319d237:::10000000354.00000000:head [write 8192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:10.294 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:10.254+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 94 slow ops, oldest is osd_op(client.4661.0:93230 4.3s0 4:c44851a4:::100000003b8.00000006:head [write 2191360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:11.290 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:11.271+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 91 slow ops, oldest is osd_op(client.4661.0:93522 4.3s0 4:c319d237:::10000000354.00000000:head [write 3657728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:12.245 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:12.241+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 92 slow ops, oldest is osd_op(client.4661.0:93685 4.3s0 4:d1367ba2:::10000000386.0000000f:head [write 159744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:13.265 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:13.239+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 91 slow ops, oldest is osd_op(client.4661.0:93940 4.3s0 4:cfc21301:::10000000369.00000016:head [write 1970176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:14.273 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:14.230+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 89 slow ops, oldest is osd_op(client.4661.0:94366 4.3s0 4:d6e7cda5:::10000000369.00000004:head [write 3768320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:15.242 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:15.196+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 88 slow ops, oldest is osd_op(client.4661.0:94963 4.3s0 4:c68b2c12:::100000003b8.00000002:head [write 2830336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:16.233 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:16.205+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 86 slow ops, oldest is osd_op(client.4661.0:95935 4.3s0 4:c493171c:::10000000368.00000002:head [write 1835008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:17.289 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:17.252+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 87 slow ops, oldest is osd_op(client.4661.0:95935 4.3s0 4:c493171c:::10000000368.00000002:head [write 1835008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:18.276 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:18.225+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4661.0:96517 4.3s0 4:d4dc1727:::10000000392.00000006:head [write 3510272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:19.282 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:19.245+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 83 slow ops, oldest is osd_op(client.4661.0:96762 4.3s0 4:cd354675:::10000000397.00000003:head [write 421888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:20.254 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:20.230+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 80 slow ops, oldest is osd_op(client.4661.0:97228 4.3s0 4:c319d237:::10000000354.00000000:head [write 135168~4096 in=4096b,write 3043328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:21.266 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:21.225+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 77 slow ops, oldest is osd_op(client.4661.0:97727 4.3s0 4:c8260a7e:::100000003ac.00000010:head [write 2576384~4096 in=4096b,write 2965504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:22.301 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:22.279+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 74 slow ops, oldest is osd_op(client.4661.0:98242 4.3s0 4:c493171c:::10000000368.00000002:head [write 1228800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:23.289 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:23.269+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 74 slow ops, oldest is osd_op(client.4661.0:98711 4.3s0 4:cfd6b1ae:::100000003ac.00000012:head [write 3518464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:24.289 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:24.248+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 70 slow ops, oldest is osd_op(client.4661.0:99247 4.3s0 4:c4c40031:::100000003ab.00000000:head [write 3665920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:25.236 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:25.209+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 65 slow ops, oldest is osd_op(client.4661.0:99886 4.3s0 4:d4dc1727:::10000000392.00000006:head [write 1916928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:26.268 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:26.239+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 62 slow ops, oldest is osd_op(client.4661.0:100629 4.3s0 4:da9dd43c:::1000000035a.00000006:head [write 2084864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:27.301 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:27.271+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 61 slow ops, oldest is osd_op(client.4661.0:101083 4.3s0 4:d7c42f57:::10000000351.0000000c:head [write 1052672~4096 in=4096b,write 2621440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:28.290 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:28.267+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 57 slow ops, oldest is osd_op(client.4661.0:101483 4.3s0 4:d4dc1727:::10000000392.00000006:head [write 2924544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:29.293 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:29.253+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 53 slow ops, oldest is osd_op(client.4661.0:102101 4.3s0 4:d0438b52:::100000003ab.0000000f:head [write 3538944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:30.236 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:30.209+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 51 slow ops, oldest is osd_op(client.4661.0:102542 4.3s0 4:da4afe7c:::10000000358.0000000f:head [write 548864~4096 in=4096b,write 856064~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:31.214 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:31.193+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4661.0:103317 4.3s0 4:d7c42f57:::10000000351.0000000c:head [write 1474560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:32.257 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:32.231+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 45 slow ops, oldest is osd_op(client.4661.0:104004 4.3s0 4:d60f17ec:::100000003b8.00000016:head [write 589824~4096 in=4096b,write 1183744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:33.265 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:33.244+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 42 slow ops, oldest is osd_op(client.4661.0:104422 4.3s0 4:d9455903:::10000000351.00000004:head [write 3489792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:34.233 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:34.218+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 40 slow ops, oldest is osd_op(client.4661.0:105200 4.3s0 4:d2e4cd79:::1000000036c.00000005:head [write 528384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:35.293 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:35.268+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 39 slow ops, oldest is osd_op(client.4661.0:105983 4.3s0 4:d60f17ec:::100000003b8.00000016:head [write 4005888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:36.322 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:36.247+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4661.0:107054 4.3s0 4:c7861165:::10000000392.00000005:head [write 131072~4096 in=4096b,write 937984~4096 in=4096b,write 2621440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:37.222 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:37.203+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4661.0:107054 4.3s0 4:c7861165:::10000000392.00000005:head [write 131072~4096 in=4096b,write 937984~4096 in=4096b,write 2621440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:38.266 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:38.231+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4661.0:107722 4.3s0 4:cdbcd030:::10000000373.00000018:head [write 2183168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:39.211 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:39.187+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4661.0:108450 4.3s0 4:d9e4ea96:::10000000358.00000010:head [write 839680~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:40.186 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:40.172+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4661.0:109122 4.3s0 4:c40e4f2f:::10000000368.00000011:head [write 1261568~4096 in=4096b,write 1306624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:41.210 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:41.186+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 23 slow ops, oldest is osd_op(client.4661.0:110505 4.3s0 4:c1f6382f:::1000000036d.0000000d:head [write 704512~4096 in=4096b,write 1433600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:42.182 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:42.160+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4661.0:110620 4.3s0 4:c010d58e:::1000000034a.00000014:head [write 3952640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:43.150 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:43.125+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4661.0:111387 4.3s0 4:c3d6fb42:::10000000365.0000000b:head [write 593920~4096 in=4096b,write 3690496~4096 in=4096b,write 3796992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:44.165 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:44.121+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4661.0:112794 4.3s0 4:cb6601bf:::100000003b9.00000002:head [write 1015808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:45.097 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:45.091+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4661.0:113147 4.3s0 4:d962bb1a:::10000000368.0000000f:head [write 1208320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:46.060 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:46.054+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4661.0:113830 4.3s0 4:cac124bc:::100000003b9.00000004:head [write 897024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:47.049 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:47.046+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4661.0:114620 4.3s0 4:df13249b:::10000000355.00000007:head [write 462848~4096 in=4096b,write 3141632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:48.023 INFO:tasks.ceph.osd.1.smithi100.stderr:2020-11-20T11:45:48.020+0000 7f9a010ff700 -1 osd.1 28 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4661.0:115188 4.3s0 4:cca4cd96:::10000000355.00000010:head [write 90112~4096 in=4096b,write 241664~4096 in=4096b,write 581632~4096 in=4096b,write 655360~4096 in=4096b,write 942080~4096 in=4096b,write 2584576~4096 in=4096b,write 3346432~4096 in=4096b,write 3371008~4096 in=4096b,write 3457024~4096 in=4096b,write 3665920~4096 in=4096b,write 3690496~4096 in=4096b,write 3772416~4096 in=4096b,write 3977216~4096 in=4096b,write 4145152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e28) 2020-11-20T11:45:54.626 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:45:54.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:45:54.631 INFO:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:45:54.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:45:54.776 INFO:teuthology.orchestra.run.smithi105:> ip netns list 2020-11-20T11:45:54.893 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T11:45:54.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:45:54.894 INFO:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:45:54.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:45:54.989 INFO:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2020-11-20T11:45:55.062 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T11:45:55.071 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T11:45:55.071 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:45:55.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.420+0000 7f357a222700 1 Processor -- start 2020-11-20T11:45:55.424 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.420+0000 7f357a222700 1 -- start start 2020-11-20T11:45:55.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357a222700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f357000c520 0x7f357000c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357a222700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3570049790 con 0x7f35700e1240 2020-11-20T11:45:55.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357a222700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700e1890 con 0x7f3570049e60 2020-11-20T11:45:55.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357a222700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35700e16a0 con 0x7f357000c520 2020-11-20T11:45:55.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f357000c520 0x7f357000c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f357000c520 0x7f357000c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42264/0 (socket says 172.21.15.105:42264) 2020-11-20T11:45:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 -- 172.21.15.105:0/3853677801 learned_addr learned my addr 172.21.15.105:0/3853677801 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 -- 172.21.15.105:0/3853677801 >> v1:172.21.15.100:6789/0 conn(0x7f3570049e60 legacy=0x7f35700dd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 -- 172.21.15.105:0/3853677801 >> v1:172.21.15.67:6789/0 conn(0x7f35700e1240 legacy=0x7f357004a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.421+0000 7f357aa23700 1 -- 172.21.15.105:0/3853677801 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700e1b30 con 0x7f357000c520 2020-11-20T11:45:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357aa23700 1 --2- 172.21.15.105:0/3853677801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f357000c520 0x7f357000c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f356c00ba20 tx=0x7f356c006ee0).ready entity=mon.2 client_cookie=4e6b6b32a2e92b22 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f3578a1f700 1 -- 172.21.15.105:0/3853677801 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c009960 con 0x7f357000c520 2020-11-20T11:45:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f3578a1f700 1 -- 172.21.15.105:0/3853677801 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c009ac0 con 0x7f357000c520 2020-11-20T11:45:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f3578a1f700 1 -- 172.21.15.105:0/3853677801 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c009e40 con 0x7f357000c520 2020-11-20T11:45:55.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357a222700 1 -- 172.21.15.105:0/3853677801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f357000c520 msgr2=0x7f357000c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357a222700 1 --2- 172.21.15.105:0/3853677801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f357000c520 0x7f357000c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f356c00ba20 tx=0x7f356c006ee0).stop 2020-11-20T11:45:55.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357a222700 1 -- 172.21.15.105:0/3853677801 shutdown_connections 2020-11-20T11:45:55.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357a222700 1 --2- 172.21.15.105:0/3853677801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f357000c520 0x7f357000c900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.430 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.422+0000 7f357a222700 1 -- 172.21.15.105:0/3853677801 >> 172.21.15.105:0/3853677801 conn(0x7f35700071f0 msgr2=0x7f3570007600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:55.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.423+0000 7f357a222700 1 -- 172.21.15.105:0/3853677801 shutdown_connections 2020-11-20T11:45:55.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.423+0000 7f357a222700 1 -- 172.21.15.105:0/3853677801 wait complete. 2020-11-20T11:45:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.424+0000 7f357a222700 1 Processor -- start 2020-11-20T11:45:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.424+0000 7f357a222700 1 -- start start 2020-11-20T11:45:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 0x7f35700c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700f2940 con 0x7f3570049e60 2020-11-20T11:45:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c66b0 con 0x7f357000c520 2020-11-20T11:45:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357a222700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c3c00 con 0x7f35700e1240 2020-11-20T11:45:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357bc85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357aa23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357aa23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60398/0 (socket says 172.21.15.105:60398) 2020-11-20T11:45:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357aa23700 1 -- 172.21.15.105:0/1543546373 learned_addr learned my addr 172.21.15.105:0/1543546373 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.425+0000 7f357bc85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42274/0 (socket says 172.21.15.105:42274) 2020-11-20T11:45:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f3579220700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 0x7f35700c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 -- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 msgr2=0x7f35700f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 -- 172.21.15.105:0/1543546373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 msgr2=0x7f35700c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 0x7f35700c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 -- 172.21.15.105:0/1543546373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700c3ea0 con 0x7f35700e1240 2020-11-20T11:45:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f3579220700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 0x7f35700c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:45:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357aa23700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357bc85700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f357405f040 tx=0x7f357405b9f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574068c50 con 0x7f35700e1240 2020-11-20T11:45:55.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574068db0 con 0x7f35700e1240 2020-11-20T11:45:55.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35700c1440 con 0x7f35700e1240 2020-11-20T11:45:55.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574067930 con 0x7f35700e1240 2020-11-20T11:45:55.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.426+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35700c1980 con 0x7f35700e1240 2020-11-20T11:45:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.429+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3574067d20 con 0x7f35700e1240 2020-11-20T11:45:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.429+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35700c1b80 con 0x7f35700e1240 2020-11-20T11:45:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.429+0000 7f3561ffb700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 0x7f354c082b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.440 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.429+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3574111eb0 con 0x7f35700e1240 2020-11-20T11:45:55.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.438+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f35700c1b80 con 0x7f35700e1240 2020-11-20T11:45:55.444 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.441+0000 7f357aa23700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 0x7f354c082b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.445 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.441+0000 7f357aa23700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 0x7f354c082b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f356c00c010 tx=0x7f356c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.687+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35700c1b80 con 0x7f35700e1240 2020-11-20T11:45:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.690+0000 7f3561ffb700 1 -- 172.21.15.105:0/1543546373 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f35700c1b80 con 0x7f35700e1240 2020-11-20T11:45:55.698 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:45:55.699 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:45:55.701 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 msgr2=0x7f354c082b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.701 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 0x7f354c082b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f356c00c010 tx=0x7f356c015000).stop 2020-11-20T11:45:55.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 msgr2=0x7f35700c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f357405f040 tx=0x7f357405b9f0).stop 2020-11-20T11:45:55.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 shutdown_connections 2020-11-20T11:45:55.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f354c080680 0x7f354c082b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35700e1240 0x7f35700c1e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f357000c520 0x7f35700f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 --2- 172.21.15.105:0/1543546373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3570049e60 0x7f35700c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.695+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 >> 172.21.15.105:0/1543546373 conn(0x7f35700071f0 msgr2=0x7f357004c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:55.704 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.696+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 shutdown_connections 2020-11-20T11:45:55.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.696+0000 7f357a222700 1 -- 172.21.15.105:0/1543546373 wait complete. 2020-11-20T11:45:55.716 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:45:55.878 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.875+0000 7f8a44049700 1 Processor -- start 2020-11-20T11:45:55.879 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.875+0000 7f8a44049700 1 -- start start 2020-11-20T11:45:55.880 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a44049700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a3c0bad60 0x7f8a3c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a44049700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a3c065180 0x7f8a3c0655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a44049700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0bed50 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a44049700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0beab0 con 0x7f8a3c065180 2020-11-20T11:45:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a44049700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0668c0 con 0x7f8a3c0bad60 2020-11-20T11:45:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a41de5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a3c0bad60 0x7f8a3c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a41de5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a3c0bad60 0x7f8a3c0bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60406/0 (socket says 172.21.15.105:60406) 2020-11-20T11:45:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a41de5700 1 -- 172.21.15.105:0/2629827658 learned_addr learned my addr 172.21.15.105:0/2629827658 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a415e4700 1 --2- 172.21.15.105:0/2629827658 >> v2:172.21.15.67:3300/0 conn(0x7f8a3c065180 0x7f8a3c0655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.876+0000 7f8a41de5700 1 -- 172.21.15.105:0/2629827658 >> v2:172.21.15.67:3300/0 conn(0x7f8a3c065180 msgr2=0x7f8a3c0655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:45:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.877+0000 7f8a41de5700 1 --2- 172.21.15.105:0/2629827658 >> v2:172.21.15.67:3300/0 conn(0x7f8a3c065180 0x7f8a3c0655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.883 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.877+0000 7f8a41de5700 1 -- 172.21.15.105:0/2629827658 >> v1:172.21.15.100:6789/0 conn(0x7f8a3c0bddf0 legacy=0x7f8a3c0be260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:45:55.883 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.877+0000 7f8a41de5700 1 -- 172.21.15.105:0/2629827658 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c066b60 con 0x7f8a3c0bad60 2020-11-20T11:45:55.883 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.877+0000 7f8a41de5700 1 --2- 172.21.15.105:0/2629827658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c0bb140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8a3c0c3380 tx=0x7f8a3400a430).ready entity=mon.1 client_cookie=71759813f8d1ee68 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.886 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.878+0000 7f8a40de3700 1 -- 172.21.15.105:0/2629827658 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34010410 con 0x7f8a3c0bad60 2020-11-20T11:45:55.886 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.878+0000 7f8a40de3700 1 -- 172.21.15.105:0/2629827658 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34010570 con 0x7f8a3c0bad60 2020-11-20T11:45:55.886 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.878+0000 7f8a40de3700 1 -- 172.21.15.105:0/2629827658 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340108f0 con 0x7f8a3c0bad60 2020-11-20T11:45:55.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 -- 172.21.15.105:0/2629827658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 msgr2=0x7f8a3c0bb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 --2- 172.21.15.105:0/2629827658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c0bb140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8a3c0c3380 tx=0x7f8a3400a430).stop 2020-11-20T11:45:55.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 -- 172.21.15.105:0/2629827658 shutdown_connections 2020-11-20T11:45:55.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 --2- 172.21.15.105:0/2629827658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c0bb140 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.887 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 --2- 172.21.15.105:0/2629827658 >> v2:172.21.15.67:3300/0 conn(0x7f8a3c065180 0x7f8a3c0655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.888 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 -- 172.21.15.105:0/2629827658 >> 172.21.15.105:0/2629827658 conn(0x7f8a3c060130 msgr2=0x7f8a3c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:55.888 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 -- 172.21.15.105:0/2629827658 shutdown_connections 2020-11-20T11:45:55.888 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.879+0000 7f8a44049700 1 -- 172.21.15.105:0/2629827658 wait complete. 2020-11-20T11:45:55.888 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.880+0000 7f8a44049700 1 Processor -- start 2020-11-20T11:45:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.880+0000 7f8a44049700 1 -- start start 2020-11-20T11:45:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a3c065180 0x7f8a3c14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c146e60 con 0x7f8a3c065180 2020-11-20T11:45:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c15c6e0 con 0x7f8a3c0bad60 2020-11-20T11:45:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a44049700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c15c980 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42286/0 (socket says 172.21.15.105:42286) 2020-11-20T11:45:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 -- 172.21.15.105:0/1231976340 learned_addr learned my addr 172.21.15.105:0/1231976340 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a415e4700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a41de5700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a3c065180 0x7f8a3c14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 -- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 msgr2=0x7f8a3c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 -- 172.21.15.105:0/1231976340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a3c065180 msgr2=0x7f8a3c14c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a3c065180 0x7f8a3c14c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a425e6700 1 -- 172.21.15.105:0/1231976340 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c15cc20 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.881+0000 7f8a415e4700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a425e6700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8a2c0096e0 tx=0x7f8a2c006d70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00d490 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00d630 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c15cec0 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00d9f0 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.882+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c15d400 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.883+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c044f60 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.883+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8a2c00f030 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.884+0000 7f8a29ffb700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 0x7f8a14082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:55.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.884+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8a2c0a2520 con 0x7f8a3c0bddf0 2020-11-20T11:45:55.895 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.884+0000 7f8a41de5700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 0x7f8a14082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:55.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.884+0000 7f8a41de5700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 0x7f8a14082af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8a3400cbb0 tx=0x7f8a3400a430).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:55.896 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:55.887+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8a2c076f30 con 0x7f8a3c0bddf0 2020-11-20T11:45:56.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.132+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a3c15fa40 con 0x7f8a14080630 2020-11-20T11:45:56.148 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.144+0000 7f8a29ffb700 1 -- 172.21.15.105:0/1231976340 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+150524 (secure 0 0 0) 0x7f8a34000f00 con 0x7f8a14080630 2020-11-20T11:45:56.150 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:45:56.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 msgr2=0x7f8a14082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 0x7f8a14082af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8a3400cbb0 tx=0x7f8a3400a430).stop 2020-11-20T11:45:56.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 msgr2=0x7f8a3c14f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8a2c0096e0 tx=0x7f8a2c006d70).stop 2020-11-20T11:45:56.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 shutdown_connections 2020-11-20T11:45:56.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8a14080630 0x7f8a14082af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a3c0bddf0 0x7f8a3c14f380 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a3c065180 0x7f8a3c14c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.147+0000 7f8a44049700 1 --2- 172.21.15.105:0/1231976340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a3c0bad60 0x7f8a3c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.148+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 >> 172.21.15.105:0/1231976340 conn(0x7f8a3c060130 msgr2=0x7f8a3c1477c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:56.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.148+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 shutdown_connections 2020-11-20T11:45:56.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.148+0000 7f8a44049700 1 -- 172.21.15.105:0/1231976340 wait complete. 2020-11-20T11:45:56.154 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:45:56.166 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2020-11-20T11:45:55.460930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11106921527,"num_objects":2675,"num_object_clones":0,"num_object_copies":10644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2675,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":285564,"num_write_kb":14242166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82281,"ondisk_log_size":82281,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":25385336,"kb_used_data":22446296,"kb_used_omap":0,"kb_used_meta":2906176,"kb_avail":1107076744,"statfs":{"total":1159641169920,"available":1133646585856,"internally_reserved":0,"allocated":22985007104,"data_stored":22983041516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2975924224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,3,4,8,6,5,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":148,"apply_latency_ms":148,"commit_latency_ns":148000000,"apply_latency_ns":148000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2325304012,"num_objects":-643,"num_object_clones":0,"num_object_copies":-2554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-643,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":2042,"num_write_kb":5648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002522"},"pg_stats":[{"pgid":"4.2","version":"28'14966","reported_seq":"14975","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:53.243858+0000","last_change":"2020-11-20T11:29:31.810475+0000","last_active":"2020-11-20T11:45:53.243858+0000","last_peered":"2020-11-20T11:45:53.243858+0000","last_clean":"2020-11-20T11:45:53.243858+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:45:53.243858+0000","last_undegraded":"2020-11-20T11:45:53.243858+0000","last_fullsized":"2020-11-20T11:45:53.243858+0000","mapping_epoch":26,"log_start":"28'4917","ondisk_log_start":"28'4917","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1438775203,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35967,"num_write_kb":1834562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808195+0000","last_change":"2020-11-20T11:29:25.767208+0000","last_active":"2020-11-20T11:29:31.808195+0000","last_peered":"2020-11-20T11:29:31.808195+0000","last_clean":"2020-11-20T11:29:31.808195+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:29:31.808195+0000","last_undegraded":"2020-11-20T11:29:31.808195+0000","last_fullsized":"2020-11-20T11:29:31.808195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'29","reported_seq":"41","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:48.468718+0000","last_change":"2020-11-20T11:29:28.782434+0000","last_active":"2020-11-20T11:45:48.468718+0000","last_peered":"2020-11-20T11:45:48.468718+0000","last_clean":"2020-11-20T11:45:48.468718+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:45:48.468718+0000","last_undegraded":"2020-11-20T11:45:48.468718+0000","last_fullsized":"2020-11-20T11:45:48.468718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"28'13819","reported_seq":"13830","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:52.712297+0000","last_change":"2020-11-20T11:29:31.798351+0000","last_active":"2020-11-20T11:45:52.712297+0000","last_peered":"2020-11-20T11:45:52.712297+0000","last_clean":"2020-11-20T11:45:52.712297+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:45:52.712297+0000","last_undegraded":"2020-11-20T11:45:52.712297+0000","last_fullsized":"2020-11-20T11:45:52.712297+0000","mapping_epoch":26,"log_start":"28'3774","ondisk_log_start":"28'3774","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10045,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1325400064,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34118,"num_write_kb":1663140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765743+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'1047","reported_seq":"1058","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.952175+0000","last_change":"2020-11-20T11:29:28.783632+0000","last_active":"2020-11-20T11:45:49.952175+0000","last_peered":"2020-11-20T11:45:49.952175+0000","last_clean":"2020-11-20T11:45:49.952175+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:45:49.952175+0000","last_undegraded":"2020-11-20T11:45:49.952175+0000","last_fullsized":"2020-11-20T11:45:49.952175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":1047,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4421052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":4629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"28'13788","reported_seq":"13799","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:52.535208+0000","last_change":"2020-11-20T11:29:31.800906+0000","last_active":"2020-11-20T11:45:52.535208+0000","last_peered":"2020-11-20T11:45:52.535208+0000","last_clean":"2020-11-20T11:45:52.535208+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:45:52.535208+0000","last_undegraded":"2020-11-20T11:45:52.535208+0000","last_fullsized":"2020-11-20T11:45:52.535208+0000","mapping_epoch":26,"log_start":"28'3737","ondisk_log_start":"28'3737","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10051,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1379926016,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33568,"num_write_kb":1743294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.791132+0000","last_change":"2020-11-20T11:29:25.767097+0000","last_active":"2020-11-20T11:29:31.791132+0000","last_peered":"2020-11-20T11:29:31.791132+0000","last_clean":"2020-11-20T11:29:31.791132+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:29:31.791132+0000","last_undegraded":"2020-11-20T11:29:31.791132+0000","last_fullsized":"2020-11-20T11:29:31.791132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'13","reported_seq":"25","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.948144+0000","last_change":"2020-11-20T11:29:28.835642+0000","last_active":"2020-11-20T11:45:49.948144+0000","last_peered":"2020-11-20T11:45:49.948144+0000","last_clean":"2020-11-20T11:45:49.948144+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:45:49.948144+0000","last_undegraded":"2020-11-20T11:45:49.948144+0000","last_fullsized":"2020-11-20T11:45:49.948144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'14282","reported_seq":"14293","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:52.205017+0000","last_change":"2020-11-20T11:29:31.810409+0000","last_active":"2020-11-20T11:45:52.205017+0000","last_peered":"2020-11-20T11:45:52.205017+0000","last_clean":"2020-11-20T11:45:52.205017+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:45:52.205017+0000","last_undegraded":"2020-11-20T11:45:52.205017+0000","last_fullsized":"2020-11-20T11:45:52.205017+0000","mapping_epoch":26,"log_start":"28'4232","ondisk_log_start":"28'4232","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10050,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1413480448,"num_objects":337,"num_object_clones":0,"num_object_copies":1348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34801,"num_write_kb":1743800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806853+0000","last_change":"2020-11-20T11:29:25.810118+0000","last_active":"2020-11-20T11:29:31.806853+0000","last_peered":"2020-11-20T11:29:31.806853+0000","last_clean":"2020-11-20T11:29:31.806853+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:29:31.806853+0000","last_undegraded":"2020-11-20T11:29:31.806853+0000","last_fullsized":"2020-11-20T11:29:31.806853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793781+0000","last_change":"2020-11-20T11:29:17.224872+0000","last_active":"2020-11-20T11:29:31.793781+0000","last_peered":"2020-11-20T11:29:31.793781+0000","last_clean":"2020-11-20T11:29:31.793781+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:29:31.793781+0000","last_undegraded":"2020-11-20T11:29:31.793781+0000","last_fullsized":"2020-11-20T11:29:31.793781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_clean_scrub_stamp":"2020-11-20T11:29:11.234877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:30:47.213189+0000","last_change":"2020-11-20T11:29:28.947687+0000","last_active":"2020-11-20T11:30:47.213189+0000","last_peered":"2020-11-20T11:30:47.213189+0000","last_clean":"2020-11-20T11:30:47.213189+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:30:47.213189+0000","last_undegraded":"2020-11-20T11:30:47.213189+0000","last_fullsized":"2020-11-20T11:30:47.213189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'14175","reported_seq":"14186","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:52.935384+0000","last_change":"2020-11-20T11:29:31.796907+0000","last_active":"2020-11-20T11:45:52.935384+0000","last_peered":"2020-11-20T11:45:52.935384+0000","last_clean":"2020-11-20T11:45:52.935384+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:45:52.935384+0000","last_undegraded":"2020-11-20T11:45:52.935384+0000","last_fullsized":"2020-11-20T11:45:52.935384+0000","mapping_epoch":26,"log_start":"28'4150","ondisk_log_start":"28'4150","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10025,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1379926016,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34086,"num_write_kb":1724632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806802+0000","last_change":"2020-11-20T11:29:25.765835+0000","last_active":"2020-11-20T11:29:31.806802+0000","last_peered":"2020-11-20T11:29:31.806802+0000","last_clean":"2020-11-20T11:29:31.806802+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:29:31.806802+0000","last_undegraded":"2020-11-20T11:29:31.806802+0000","last_fullsized":"2020-11-20T11:29:31.806802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'66","reported_seq":"102","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.948476+0000","last_change":"2020-11-20T11:29:28.783019+0000","last_active":"2020-11-20T11:45:49.948476+0000","last_peered":"2020-11-20T11:45:49.948476+0000","last_clean":"2020-11-20T11:45:49.948476+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:45:49.948476+0000","last_undegraded":"2020-11-20T11:45:49.948476+0000","last_fullsized":"2020-11-20T11:45:49.948476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":68,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'15439","reported_seq":"15449","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:53.391758+0000","last_change":"2020-11-20T11:29:31.810862+0000","last_active":"2020-11-20T11:45:53.391758+0000","last_peered":"2020-11-20T11:45:53.391758+0000","last_clean":"2020-11-20T11:45:53.391758+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:45:53.391758+0000","last_undegraded":"2020-11-20T11:45:53.391758+0000","last_fullsized":"2020-11-20T11:45:53.391758+0000","mapping_epoch":26,"log_start":"28'5397","ondisk_log_start":"28'5397","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10042,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1417674752,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37345,"num_write_kb":1831709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793228+0000","last_change":"2020-11-20T11:29:25.765870+0000","last_active":"2020-11-20T11:29:31.793228+0000","last_peered":"2020-11-20T11:29:31.793228+0000","last_clean":"2020-11-20T11:29:31.793228+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:29:31.793228+0000","last_undegraded":"2020-11-20T11:29:31.793228+0000","last_fullsized":"2020-11-20T11:29:31.793228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'558","reported_seq":"570","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.324727+0000","last_change":"2020-11-20T11:29:28.781951+0000","last_active":"2020-11-20T11:45:49.324727+0000","last_peered":"2020-11-20T11:45:49.324727+0000","last_clean":"2020-11-20T11:45:49.324727+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:45:49.324727+0000","last_undegraded":"2020-11-20T11:45:49.324727+0000","last_fullsized":"2020-11-20T11:45:49.324727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":558,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'14666","reported_seq":"14677","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:52.578113+0000","last_change":"2020-11-20T11:29:31.810620+0000","last_active":"2020-11-20T11:45:52.578113+0000","last_peered":"2020-11-20T11:45:52.578113+0000","last_clean":"2020-11-20T11:45:52.578113+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:45:52.578113+0000","last_undegraded":"2020-11-20T11:45:52.578113+0000","last_fullsized":"2020-11-20T11:45:52.578113+0000","mapping_epoch":26,"log_start":"28'4592","ondisk_log_start":"28'4592","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1333788672,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36534,"num_write_kb":1763006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'10","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:48.403300+0000","last_change":"2020-11-20T11:29:28.835613+0000","last_active":"2020-11-20T11:45:48.403300+0000","last_peered":"2020-11-20T11:45:48.403300+0000","last_clean":"2020-11-20T11:45:48.403300+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:45:48.403300+0000","last_undegraded":"2020-11-20T11:45:48.403300+0000","last_fullsized":"2020-11-20T11:45:48.403300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.788241+0000","last_change":"2020-11-20T11:29:26.041682+0000","last_active":"2020-11-20T11:29:31.788241+0000","last_peered":"2020-11-20T11:29:31.788241+0000","last_clean":"2020-11-20T11:29:31.788241+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:29:31.788241+0000","last_undegraded":"2020-11-20T11:29:31.788241+0000","last_fullsized":"2020-11-20T11:29:31.788241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'15384","reported_seq":"15395","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:53.801535+0000","last_change":"2020-11-20T11:29:31.843080+0000","last_active":"2020-11-20T11:45:53.801535+0000","last_peered":"2020-11-20T11:45:53.801535+0000","last_clean":"2020-11-20T11:45:53.801535+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:45:53.801535+0000","last_undegraded":"2020-11-20T11:45:53.801535+0000","last_fullsized":"2020-11-20T11:45:53.801535+0000","mapping_epoch":26,"log_start":"28'5304","ondisk_log_start":"28'5304","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10080,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1409286144,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37082,"num_write_kb":1928765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793857+0000","last_change":"2020-11-20T11:29:25.765016+0000","last_active":"2020-11-20T11:29:31.793857+0000","last_peered":"2020-11-20T11:29:31.793857+0000","last_clean":"2020-11-20T11:29:31.793857+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:29:31.793857+0000","last_undegraded":"2020-11-20T11:29:31.793857+0000","last_fullsized":"2020-11-20T11:29:31.793857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'135","reported_seq":"147","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.945266+0000","last_change":"2020-11-20T11:29:28.780167+0000","last_active":"2020-11-20T11:45:49.945266+0000","last_peered":"2020-11-20T11:45:49.945266+0000","last_clean":"2020-11-20T11:45:49.945266+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:45:49.945266+0000","last_undegraded":"2020-11-20T11:45:49.945266+0000","last_fullsized":"2020-11-20T11:45:49.945266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":135,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":11098257315,"num_objects":2647,"num_object_clones":0,"num_object_copies":10588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283501,"num_write_kb":14232908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22402039808,"data_stored":22402039808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80416,"ondisk_log_size":80416,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8664212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":2060,"num_write_kb":9243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17391616,"data_stored":17328424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444234,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1626584,"kb_used_data":1438032,"kb_used_omap":0,"kb_used_meta":188544,"kb_avail":92745256,"statfs":{"total":96636764160,"available":94971142144,"internally_reserved":0,"allocated":1472544768,"data_stored":1472384561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":193069056},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":1.04,"15min":1.0129999999999999},"min":{"1min":0.66800000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1459999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.143,"15min":1.167},"min":{"1min":0.68100000000000005,"5min":0.62,"15min":0.62},"max":{"1min":1.2410000000000001,"5min":3.875,"15min":6.468},"last":1.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.5229999999999999,"15min":1.446},"min":{"1min":0.77000000000000002,"5min":0.621,"15min":0.621},"max":{"1min":1.645,"5min":12.504,"15min":12.504},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.254,"15min":1.2250000000000001},"min":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.56699999999999995},"max":{"1min":1.341,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.4370000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.071,"15min":1.0640000000000001},"min":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"max":{"1min":1.0429999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.4810000000000001,"15min":1.506},"min":{"1min":0.73899999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6559999999999999,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":2}]},{"osd":4,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":6.5700000000000003,"15min":4.1929999999999996},"min":{"1min":0.874,"5min":0.74099999999999999,"15min":0.73199999999999998},"max":{"1min":1.482,"5min":52.670000000000002,"15min":52.670000000000002},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":6.7469999999999999,"15min":4.2409999999999997},"min":{"1min":0.85999999999999999,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.361,"5min":52.637,"15min":52.637},"last":1.544}]},{"osd":5,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6799999999999999,"5min":4.3380000000000001,"15min":5.0599999999999996},"last":2.2000000000000002},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.458,"15min":1.4610000000000001},"min":{"1min":0.97099999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.552,"5min":9.0850000000000009,"15min":9.0850000000000009},"last":1.9410000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.837,"15min":1.8420000000000001},"min":{"1min":1.248,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.0070000000000001,"5min":5.9199999999999999,"15min":5.9199999999999999},"last":4.6470000000000002},{"interface":"front","average":{"1min":1.516,"5min":1.734,"15min":1.754},"min":{"1min":1.173,"5min":1.034,"15min":0.98699999999999999},"max":{"1min":1.907,"5min":5.8739999999999997,"15min":6.9279999999999999},"last":4.6829999999999998}]},{"osd":7,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.6599999999999999,"15min":1.923},"min":{"1min":1.1080000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7110000000000001,"5min":5.6669999999999998,"15min":69.603999999999999},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.585,"5min":1.8080000000000001,"15min":2.0790000000000002},"min":{"1min":1.351,"5min":1.151,"15min":1.151},"max":{"1min":1.8160000000000001,"5min":4.9000000000000004,"15min":66.614999999999995},"last":2.1419999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.7729999999999999,"15min":1.837},"min":{"1min":1.1970000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.972,"5min":5.7960000000000003,"15min":6.2759999999999998},"last":2.242},{"interface":"front","average":{"1min":1.6579999999999999,"5min":1.9059999999999999,"15min":1.9850000000000001},"min":{"1min":1.3560000000000001,"5min":1.2230000000000001,"15min":1.208},"max":{"1min":2.0899999999999999,"5min":4.8929999999999998,"15min":5.4790000000000001},"last":2.403}]},{"osd":9,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":2.0310000000000001,"15min":2.0499999999999998},"min":{"1min":1.431,"5min":1.28,"15min":1.218},"max":{"1min":2.101,"5min":6.4669999999999996,"15min":6.6299999999999999},"last":2.274},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.782,"15min":1.7729999999999999},"min":{"1min":1.256,"5min":1.0620000000000001,"15min":1.0580000000000001},"max":{"1min":1.861,"5min":5.2080000000000002,"15min":5.2080000000000002},"last":2.0539999999999998}]},{"osd":10,"last update":"Fri Nov 20 11:44:51 2020","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":2.4900000000000002,"15min":2.875},"min":{"1min":1.27,"5min":1.085,"15min":1.085},"max":{"1min":3.2040000000000002,"5min":18.969000000000001,"15min":34.558},"last":3.7410000000000001},{"interface":"front","average":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":3.0049999999999999},"min":{"1min":1.4690000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":2.0859999999999999,"5min":21.318000000000001,"15min":33.133000000000003},"last":2.5310000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444233,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2271656,"kb_used_data":1999136,"kb_used_omap":0,"kb_used_meta":268416,"kb_avail":92100184,"statfs":{"total":96636764160,"available":94310588416,"internally_reserved":0,"allocated":2047115264,"data_stored":2046956731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":274857984},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":6.1109999999999998,"5min":11.266,"15min":6.9329999999999998},"min":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":15.944000000000001,"5min":75.784000000000006,"15min":75.784000000000006},"last":0.98199999999999998},{"interface":"front","average":{"1min":6.8760000000000003,"5min":11.898999999999999,"15min":7.165},"min":{"1min":0.77000000000000002,"5min":0.63,"15min":0.60099999999999998},"max":{"1min":16.329999999999998,"5min":75.831000000000003,"15min":75.831000000000003},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.7030000000000001,"15min":1.724},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.57199999999999995},"max":{"1min":2.8599999999999999,"5min":20.370000000000001,"15min":31.071000000000002},"last":1.341},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.8999999999999999,"15min":1.847},"min":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.53400000000000003},"max":{"1min":3.4590000000000001,"5min":24.312999999999999,"15min":24.312999999999999},"last":1.7689999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.853,"15min":1.7589999999999999},"min":{"1min":0.66200000000000003,"5min":0.57099999999999995,"15min":0.54500000000000004},"max":{"1min":2.6960000000000002,"5min":20.204000000000001,"15min":25.420999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.589,"15min":1.7030000000000001},"min":{"1min":0.94799999999999995,"5min":0.67400000000000004,"15min":0.53500000000000003},"max":{"1min":2.9380000000000002,"5min":19.760000000000002,"15min":20.030999999999999},"last":1.593}]},{"osd":4,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":6.8760000000000003,"15min":5.3209999999999997},"min":{"1min":0.73099999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":3.2509999999999999,"5min":35.222999999999999,"15min":43.152999999999999},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.5860000000000001,"5min":8.8019999999999996,"15min":6.2190000000000003},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.84199999999999997},"max":{"1min":3.8599999999999999,"5min":44.122,"15min":46.593000000000004},"last":1.6439999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":2.456,"15min":2.3079999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.63},"max":{"1min":2.5939999999999999,"5min":26.366,"15min":26.366},"last":2.27},{"interface":"front","average":{"1min":1.4019999999999999,"5min":2.6019999999999999,"15min":2.3639999999999999},"min":{"1min":0.71599999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.956,"5min":40.494,"15min":40.494},"last":1.7230000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":2.786,"15min":2.2719999999999998},"min":{"1min":0.76300000000000001,"5min":0.74399999999999999,"15min":0.59499999999999997},"max":{"1min":3.6600000000000001,"5min":25.873999999999999,"15min":25.873999999999999},"last":1.9219999999999999},{"interface":"front","average":{"1min":1.552,"5min":2.6509999999999998,"15min":2.5230000000000001},"min":{"1min":0.93600000000000005,"5min":0.74299999999999999,"15min":0.73299999999999998},"max":{"1min":2.9140000000000001,"5min":23.809000000000001,"15min":25.771000000000001},"last":1.8799999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":2.7490000000000001,"15min":2.5339999999999998},"min":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.351,"5min":23.800000000000001,"15min":24.831},"last":1.986},{"interface":"front","average":{"1min":1.7509999999999999,"5min":3.1030000000000002,"15min":2.5800000000000001},"min":{"1min":0.84899999999999998,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":3.9590000000000001,"5min":24.748999999999999,"15min":24.748999999999999},"last":2.0489999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:44:59 2020","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":2.9020000000000001,"15min":2.7989999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.80200000000000005},"max":{"1min":2.9140000000000001,"5min":25.623999999999999,"15min":26.324000000000002},"last":2.1480000000000001},{"interface":"front","average":{"1min":1.825,"5min":3.085,"15min":2.9340000000000002},"min":{"1min":1.194,"5min":0.92500000000000004,"15min":0.70499999999999996},"max":{"1min":3.1619999999999999,"5min":40.624000000000002,"15min":40.624000000000002},"last":2.129}]},{"osd":9,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":3.6179999999999999,"15min":2.9550000000000001},"min":{"1min":1.0660000000000001,"5min":0.90900000000000003,"15min":0.81100000000000005},"max":{"1min":6.4560000000000004,"5min":29.969999999999999,"15min":29.969999999999999},"last":2.1139999999999999},{"interface":"front","average":{"1min":2.0870000000000002,"5min":3.4249999999999998,"15min":2.9580000000000002},"min":{"1min":1.115,"5min":0.97299999999999998,"15min":0.80100000000000005},"max":{"1min":6.5700000000000003,"5min":29.881,"15min":29.881},"last":2.02}]},{"osd":11,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.8149999999999999,"5min":3.238,"15min":2.9329999999999998},"min":{"1min":1.127,"5min":1.004,"15min":1.004},"max":{"1min":3.1549999999999998,"5min":30.013999999999999,"15min":30.013999999999999},"last":2.2490000000000001},{"interface":"front","average":{"1min":1.8740000000000001,"5min":3.4249999999999998,"15min":3.1419999999999999},"min":{"1min":0.98399999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.7589999999999999,"5min":25.626000000000001,"15min":28.550999999999998},"last":2.1850000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444233,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3288780,"kb_used_data":2931268,"kb_used_omap":0,"kb_used_meta":357504,"kb_avail":91083060,"statfs":{"total":96636764160,"available":93269053440,"internally_reserved":0,"allocated":3001618432,"data_stored":3001453175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":366084096},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":0.93999999999999995},"min":{"1min":0.76000000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.331,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":1.339},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.70899999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.9330000000000001,"5min":5.3170000000000002,"15min":6.7969999999999997},"last":1.3009999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":8.2119999999999997,"15min":6.3630000000000004},"min":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.65100000000000002},"max":{"1min":16.420999999999999,"5min":37.811999999999998,"15min":114.867},"last":1.655},{"interface":"front","average":{"1min":2.7330000000000001,"5min":8.1440000000000001,"15min":6.1429999999999998},"min":{"1min":0.73899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":16.260999999999999,"5min":37.152999999999999,"15min":114.36799999999999},"last":1.022}]},{"osd":2,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.248,"15min":1.6040000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7050000000000001,"5min":7.0990000000000002,"15min":53.234000000000002},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.3580000000000001,"15min":1.669},"min":{"1min":0.88900000000000001,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.8720000000000001,"5min":5.5919999999999996,"15min":54.753},"last":2.0529999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.405,"15min":1.3879999999999999},"min":{"1min":0.81299999999999994,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.768,"5min":5.6390000000000002,"15min":7.2080000000000002},"last":2.468},{"interface":"front","average":{"1min":1.361,"5min":1.4610000000000001,"15min":1.411},"min":{"1min":1.097,"5min":0.746,"15min":0.746},"max":{"1min":1.899,"5min":7.234,"15min":7.234},"last":1.159}]},{"osd":4,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":4.5919999999999996,"15min":3.927},"min":{"1min":1.246,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0139999999999998,"5min":37.531999999999996,"15min":84.661000000000001},"last":2.2879999999999998},{"interface":"front","average":{"1min":1.5369999999999999,"5min":4.6280000000000001,"15min":3.9750000000000001},"min":{"1min":1.0069999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.327,"5min":37.469000000000001,"15min":84.811000000000007},"last":1.7929999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":1.804},"min":{"1min":1.012,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0960000000000001,"5min":7.3639999999999999,"15min":53.052},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.702,"15min":1.869},"min":{"1min":1.321,"5min":1.05,"15min":1.0189999999999999},"max":{"1min":2.137,"5min":6.1299999999999999,"15min":53.853000000000002},"last":2.1739999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.7330000000000001,"15min":1.706},"min":{"1min":1.1919999999999999,"5min":1.03,"15min":1.03},"max":{"1min":2.0630000000000002,"5min":5.7720000000000002,"15min":7.3410000000000002},"last":2.2410000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.698,"15min":1.7110000000000001},"min":{"1min":1.1719999999999999,"5min":1,"15min":0.84399999999999997},"max":{"1min":2.282,"5min":7.5979999999999999,"15min":9.0199999999999996},"last":1.5269999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.869,"15min":2.1190000000000002},"min":{"1min":1.3029999999999999,"5min":1.163,"15min":1.163},"max":{"1min":2.2629999999999999,"5min":7.7619999999999996,"15min":54.600999999999999},"last":3.2959999999999998},{"interface":"front","average":{"1min":1.706,"5min":1.893,"15min":2.2789999999999999},"min":{"1min":1.276,"5min":1.139,"15min":1.139},"max":{"1min":2.1989999999999998,"5min":9.8450000000000006,"15min":55.698},"last":2.129}]},{"osd":10,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8899999999999999,"15min":2.6320000000000001},"min":{"1min":1.3400000000000001,"5min":1.2430000000000001,"15min":1.2},"max":{"1min":3.1179999999999999,"5min":7.484,"15min":21.552},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.802,"5min":1.958,"15min":2.5529999999999999},"min":{"1min":1.411,"5min":1.173,"15min":1.0760000000000001},"max":{"1min":3.1389999999999998,"5min":6.9050000000000002,"15min":21.600999999999999},"last":2.4060000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.9239999999999999,"15min":2.0880000000000001},"min":{"1min":1.3240000000000001,"5min":1.2290000000000001,"15min":1.157},"max":{"1min":2.468,"5min":6.0499999999999998,"15min":53.317},"last":2.3540000000000001},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.9179999999999999,"15min":2.1309999999999998},"min":{"1min":1.4159999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.23,"5min":7.7270000000000003,"15min":53.140000000000001},"last":2.028}]}]},{"osd":8,"up_from":17,"seq":73014444233,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2314680,"kb_used_data":2038064,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":92057160,"statfs":{"total":96636764160,"available":94266531840,"internally_reserved":0,"allocated":2086977536,"data_stored":2086803422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.3100000000000001},"min":{"1min":0.65300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2989999999999999,"5min":8.1590000000000007,"15min":71.022999999999996},"last":4.0119999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":1.329,"15min":1.3899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56100000000000005},"max":{"1min":1.151,"5min":17.373999999999999,"15min":70.582999999999998},"last":2.827}]},{"osd":1,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":6.7199999999999998,"5min":10.445,"15min":5.6349999999999998},"min":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":25.577999999999999,"5min":55.158999999999999,"15min":55.158999999999999},"last":8.1590000000000007},{"interface":"front","average":{"1min":8.0370000000000008,"5min":10.922000000000001,"15min":5.9500000000000002},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.91500000000000004},"max":{"1min":25.536000000000001,"5min":55.703000000000003,"15min":55.703000000000003},"last":8.1859999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.4119999999999999,"15min":1.387},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3879999999999999,"5min":8.8699999999999992,"15min":8.8699999999999992},"last":4.9950000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.3380000000000001,"15min":1.234},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.624},"max":{"1min":1.3640000000000001,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":5.0270000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.6699999999999999,"15min":1.7689999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.9570000000000001,"5min":17.640000000000001,"15min":70.391000000000005},"last":2.1230000000000002},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.647,"15min":1.831},"min":{"1min":0.999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8149999999999999,"5min":8.4659999999999993,"15min":70.510000000000005},"last":4.6429999999999998}]},{"osd":4,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":6.2750000000000004,"15min":4.5170000000000003},"min":{"1min":1.129,"5min":0.94299999999999995,"15min":0.88300000000000001},"max":{"1min":2.1419999999999999,"5min":49.796999999999997,"15min":88.828000000000003},"last":4.7649999999999997},{"interface":"front","average":{"1min":1.2330000000000001,"5min":5.4829999999999997,"15min":4.1289999999999996},"min":{"1min":0.95399999999999996,"5min":0.72499999999999998,"15min":0.69899999999999995},"max":{"1min":2.077,"5min":49.468000000000004,"15min":88.775999999999996},"last":1.3540000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.425,"15min":1.55},"min":{"1min":0.90700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9359999999999999,"5min":8.2010000000000005,"15min":8.2010000000000005},"last":2.0070000000000001},{"interface":"front","average":{"1min":1.397,"5min":2.0299999999999998,"15min":1.893},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":0.90300000000000002},"max":{"1min":2.1739999999999999,"5min":19.702999999999999,"15min":19.702999999999999},"last":2.4489999999999998}]},{"osd":7,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":2.222,"15min":2.0369999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.4079999999999999,"5min":18.169,"15min":18.169},"last":2.2280000000000002},{"interface":"front","average":{"1min":1.639,"5min":1.9890000000000001,"15min":1.9690000000000001},"min":{"1min":1.2709999999999999,"5min":1.1439999999999999,"15min":1.125},"max":{"1min":4.2460000000000004,"5min":8.7460000000000004,"15min":9.4499999999999993},"last":5.9939999999999998}]},{"osd":9,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.599,"15min":1.9359999999999999},"min":{"1min":1.163,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.2160000000000002,"5min":7.7770000000000001,"15min":70.606999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":2.286,"15min":2.3380000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3039999999999998,"5min":18.033999999999999,"15min":75.585999999999999},"last":2.3370000000000002}]},{"osd":10,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":2.794,"15min":3.2029999999999998},"min":{"1min":1.343,"5min":1.2170000000000001,"15min":1.171},"max":{"1min":1.9510000000000001,"5min":19.209,"15min":73.167000000000002},"last":7.077},{"interface":"front","average":{"1min":1.589,"5min":2.4609999999999999,"15min":3.0379999999999998},"min":{"1min":1.294,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.3319999999999999,"5min":16.661000000000001,"15min":73.046999999999997},"last":3.3119999999999998}]},{"osd":11,"last update":"Fri Nov 20 11:44:50 2020","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.524,"15min":2.2650000000000001},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.1519999999999999},"max":{"1min":2.48,"5min":18.279,"15min":18.279},"last":3.762},{"interface":"front","average":{"1min":1.673,"5min":2.0720000000000001,"15min":2.0649999999999999},"min":{"1min":1.413,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":2.0699999999999998,"5min":9.359,"15min":9.359},"last":4.8810000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444233,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1633712,"kb_used_data":1458536,"kb_used_omap":0,"kb_used_meta":169024,"kb_avail":92738128,"statfs":{"total":96636764160,"available":94963843072,"internally_reserved":0,"allocated":1493540864,"data_stored":1493374714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":173080576},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.1359999999999999},"min":{"1min":0.55100000000000005,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":1.667,"5min":3.9369999999999998,"15min":39.671999999999997},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":1.1160000000000001},"min":{"1min":0.627,"5min":0.54700000000000004,"15min":0.496},"max":{"1min":2.7589999999999999,"5min":4.21,"15min":36.548000000000002},"last":2.7589999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":8.4309999999999992,"15min":6.0629999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.61499999999999999},"max":{"1min":17.905999999999999,"5min":51.244999999999997,"15min":115.669},"last":1.992},{"interface":"front","average":{"1min":3.5960000000000001,"5min":9.0039999999999996,"15min":6.1980000000000004},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.63500000000000001},"max":{"1min":18.001000000000001,"5min":51.121000000000002,"15min":115.831},"last":3.722}]},{"osd":2,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.421,"15min":1.6279999999999999},"min":{"1min":0.73399999999999999,"5min":0.63800000000000001,"15min":0.46800000000000003},"max":{"1min":3.2810000000000001,"5min":5.8120000000000003,"15min":52.776000000000003},"last":3.2810000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.355,"15min":1.5609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":6.931,"5min":8.5619999999999994,"15min":52.869999999999997},"last":6.931}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2669999999999999,"15min":1.571},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.875,"5min":4.3300000000000001,"15min":39.496000000000002},"last":2.875},{"interface":"front","average":{"1min":1.49,"5min":1.639,"15min":1.651},"min":{"1min":0.93000000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.9020000000000001,"5min":6.7359999999999998,"15min":37.078000000000003},"last":1.1060000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":4.4820000000000002,"15min":4.7359999999999998},"min":{"1min":0.86499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.0940000000000003,"5min":29.015000000000001,"15min":115.108},"last":4.0940000000000003},{"interface":"front","average":{"1min":1.611,"5min":4.843,"15min":4.9210000000000003},"min":{"1min":1.04,"5min":0.623,"15min":0.623},"max":{"1min":2.98,"5min":29.611999999999998,"15min":114.602},"last":2.98}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5409999999999999,"15min":1.6950000000000001},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.76600000000000001},"max":{"1min":3.1779999999999999,"5min":4.4539999999999997,"15min":37.802},"last":3.1779999999999999},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.772,"15min":1.849},"min":{"1min":1.0189999999999999,"5min":0.89100000000000001,"15min":0.73599999999999999},"max":{"1min":3.1440000000000001,"5min":6.8920000000000003,"15min":37.234000000000002},"last":1.284}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.476,"15min":1.752},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.60299999999999998},"max":{"1min":3.9750000000000001,"5min":4.9139999999999997,"15min":53.584000000000003},"last":3.9750000000000001},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.73,"15min":1.9490000000000001},"min":{"1min":1.0429999999999999,"5min":0.84499999999999997,"15min":0.73299999999999998},"max":{"1min":3.0819999999999999,"5min":4.6929999999999996,"15min":52.744},"last":3.0819999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.847,"15min":2.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.028,"5min":7.1680000000000001,"15min":35.851999999999997},"last":1.419},{"interface":"front","average":{"1min":1.776,"5min":1.6000000000000001,"15min":1.7769999999999999},"min":{"1min":1.069,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":3.8559999999999999,"5min":4.1849999999999996,"15min":36.921999999999997},"last":3.8559999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.925,"5min":1.9630000000000001,"15min":2.8180000000000001},"min":{"1min":1.171,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":3.411,"5min":8.5410000000000004,"15min":113.55800000000001},"last":3.411},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.9670000000000001,"15min":2.9940000000000002},"min":{"1min":1.103,"5min":1.0700000000000001,"15min":0.85799999999999998},"max":{"1min":3.286,"5min":7.0389999999999997,"15min":117.624},"last":2.577}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.7509999999999999,"15min":1.881},"min":{"1min":1.165,"5min":0.90200000000000002,"15min":0.77400000000000002},"max":{"1min":4.2169999999999996,"5min":4.8390000000000004,"15min":34.616999999999997},"last":4.2169999999999996},{"interface":"front","average":{"1min":1.877,"5min":1.8859999999999999,"15min":1.986},"min":{"1min":1.3300000000000001,"5min":1.0569999999999999,"15min":0.96199999999999997},"max":{"1min":3.302,"5min":4.9199999999999999,"15min":34.640000000000001},"last":3.302}]}]},{"osd":6,"up_from":17,"seq":73014444234,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3206624,"kb_used_data":2849112,"kb_used_omap":0,"kb_used_meta":357504,"kb_avail":91165216,"statfs":{"total":96636764160,"available":93353181184,"internally_reserved":0,"allocated":2917490688,"data_stored":2917322449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":366084096},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":5.5330000000000004,"5min":9.1069999999999993,"15min":4.944},"min":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.56299999999999994},"max":{"1min":27.448,"5min":61.689,"15min":61.689},"last":2.2959999999999998},{"interface":"front","average":{"1min":5.5,"5min":8.3390000000000004,"15min":4.774},"min":{"1min":0.65800000000000003,"5min":0.58399999999999996,"15min":0.57999999999999996},"max":{"1min":27.423999999999999,"5min":44.164000000000001,"15min":44.350999999999999},"last":2.1259999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":1.048,"15min":1.085},"min":{"1min":0.66500000000000004,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0069999999999999,"5min":4.274,"15min":5.242},"last":2.3380000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.1579999999999999,"15min":1.149},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56899999999999995},"max":{"1min":1.292,"5min":6.6609999999999996,"15min":7.4770000000000003},"last":0.98999999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.1619999999999999,"15min":1.0740000000000001},"min":{"1min":0.63400000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8440000000000001,"5min":5.0739999999999998,"15min":8.2520000000000007},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.222,"15min":1.115},"min":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"max":{"1min":1.7849999999999999,"5min":4.3070000000000004,"15min":5.758},"last":2.657}]},{"osd":4,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":5.3339999999999996,"15min":3.7240000000000002},"min":{"1min":0.88600000000000001,"5min":0.76100000000000001,"15min":0.70299999999999996},"max":{"1min":5.4539999999999997,"5min":54.881,"15min":54.881},"last":3.1789999999999998},{"interface":"front","average":{"1min":1.5029999999999999,"5min":5.7149999999999999,"15min":3.891},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":5.4779999999999998,"5min":54.957999999999998,"15min":54.957999999999998},"last":3.3069999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.5580000000000001,"15min":1.464},"min":{"1min":0.97299999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8360000000000001,"5min":7.1909999999999998,"15min":7.7300000000000004},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.494,"15min":1.452},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.72099999999999997},"max":{"1min":2.1419999999999999,"5min":6.4539999999999997,"15min":7.5419999999999998},"last":1.274}]},{"osd":7,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.573,"15min":1.4710000000000001},"min":{"1min":0.877,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0179999999999998,"5min":7.2460000000000004,"15min":8.3800000000000008},"last":1.798},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.526,"15min":1.494},"min":{"1min":1.083,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9730000000000001,"5min":4.1020000000000003,"15min":6.0229999999999997},"last":2.5339999999999998}]},{"osd":8,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.696,"15min":1.615},"min":{"1min":1.0620000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.861,"5min":7.4710000000000001,"15min":7.4710000000000001},"last":1.728},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.996,"15min":1.8859999999999999},"min":{"1min":1.0329999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.2570000000000001,"5min":10.055999999999999,"15min":10.065},"last":1.4059999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.639,"15min":1.6359999999999999},"min":{"1min":1.2010000000000001,"5min":1.026,"15min":0.95699999999999996},"max":{"1min":2.165,"5min":4.4429999999999996,"15min":6.141},"last":3.0059999999999998},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7649999999999999,"15min":1.6839999999999999},"min":{"1min":1.1399999999999999,"5min":0.98899999999999999,"15min":0.82699999999999996},"max":{"1min":1.956,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":2.2309999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":2.2130000000000001,"15min":2.1699999999999999},"min":{"1min":1.4259999999999999,"5min":1.145,"15min":1.1120000000000001},"max":{"1min":2.0379999999999998,"5min":14.461,"15min":18.337},"last":2.8900000000000001},{"interface":"front","average":{"1min":1.629,"5min":2.2890000000000001,"15min":2.2549999999999999},"min":{"1min":1.2110000000000001,"5min":1.0569999999999999,"15min":0.93600000000000005},"max":{"1min":1.99,"5min":13.917999999999999,"15min":23.823},"last":1.8720000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.835,"15min":1.7509999999999999},"min":{"1min":1.099,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":2.3730000000000002,"5min":6.6059999999999999,"15min":7.9660000000000002},"last":2.2599999999999998},{"interface":"front","average":{"1min":1.7050000000000001,"5min":1.8540000000000001,"15min":1.796},"min":{"1min":1.3420000000000001,"5min":1.163,"15min":1.119},"max":{"1min":2.1019999999999999,"5min":5.2089999999999996,"15min":6.2640000000000002},"last":2.7749999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2328112,"kb_used_data":2060648,"kb_used_omap":0,"kb_used_meta":267456,"kb_avail":92043728,"statfs":{"total":96636764160,"available":94252777472,"internally_reserved":0,"allocated":2110103552,"data_stored":2109937470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":273874944},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,2,4,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":5.0309999999999997,"15min":3.8330000000000002},"min":{"1min":0.72399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":19.308,"5min":44.576000000000001,"15min":57.322000000000003},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.7400000000000002,"5min":6.452,"15min":3.722},"min":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.61299999999999999},"max":{"1min":20.452999999999999,"5min":68.094999999999999,"15min":68.094999999999999},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":6.2800000000000002,"15min":4.6559999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"max":{"1min":19.183,"5min":64.680000000000007,"15min":64.680000000000007},"last":0.78700000000000003},{"interface":"front","average":{"1min":3.5950000000000002,"5min":5.2889999999999997,"15min":3.5449999999999999},"min":{"1min":0.66300000000000003,"5min":0.63,"15min":0.63},"max":{"1min":19.152999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.931,"5min":6.6050000000000004,"15min":4.4480000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":20.582000000000001,"5min":68.230000000000004,"15min":68.230000000000004},"last":0.751},{"interface":"front","average":{"1min":5.9900000000000002,"5min":7.9950000000000001,"15min":5.2060000000000004},"min":{"1min":0.98999999999999999,"5min":0.85699999999999998,"15min":0.66900000000000004},"max":{"1min":19.859000000000002,"5min":64.951999999999998,"15min":64.951999999999998},"last":1.02}]},{"osd":4,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":17.652999999999999,"15min":11.912000000000001},"min":{"1min":0.87,"5min":0.71499999999999997,"15min":0.66000000000000003},"max":{"1min":20.414000000000001,"5min":68.141000000000005,"15min":68.141000000000005},"last":14.832000000000001},{"interface":"front","average":{"1min":6.157,"5min":16.033999999999999,"15min":11.202},"min":{"1min":0.76900000000000002,"5min":0.751,"15min":0.63500000000000001},"max":{"1min":19.780000000000001,"5min":68.816000000000003,"15min":68.816000000000003},"last":14.718}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.2050000000000001,"5min":6.8840000000000003,"15min":4.6050000000000004},"min":{"1min":0.84899999999999998,"5min":0.78500000000000003,"15min":0.76100000000000001},"max":{"1min":19.414000000000001,"5min":64.760999999999996,"15min":64.760999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":7.2839999999999998,"5min":9.4559999999999995,"15min":5.976},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.81499999999999995},"max":{"1min":21.158999999999999,"5min":68.406000000000006,"15min":68.406000000000006},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.5800000000000001,"5min":11.606,"15min":7.2130000000000001},"min":{"1min":1.1970000000000001,"5min":0.98699999999999999,"15min":0.73499999999999999},"max":{"1min":20.064,"5min":64.828999999999994,"15min":64.828999999999994},"last":0.70199999999999996},{"interface":"front","average":{"1min":9.4830000000000005,"5min":10.178000000000001,"15min":6.1470000000000002},"min":{"1min":1.1439999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":20.606999999999999,"5min":64.905000000000001,"15min":64.905000000000001},"last":0.71899999999999997}]},{"osd":8,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":7.2530000000000001,"5min":9.9480000000000004,"15min":6.2359999999999998},"min":{"1min":1.1020000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":20.085000000000001,"5min":64.637,"15min":64.637},"last":1.107},{"interface":"front","average":{"1min":8.6590000000000007,"5min":12.173999999999999,"15min":7.04},"min":{"1min":1.173,"5min":0.98899999999999999,"15min":0.97499999999999998},"max":{"1min":21.402999999999999,"5min":85.200000000000003,"15min":85.200000000000003},"last":0.98599999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":9.6660000000000004,"5min":13.859999999999999,"15min":7.4699999999999998},"min":{"1min":1.0549999999999999,"5min":1.048,"15min":1.036},"max":{"1min":21.271000000000001,"5min":85.361000000000004,"15min":85.361000000000004},"last":1.1200000000000001},{"interface":"front","average":{"1min":8.4830000000000005,"5min":11.747,"15min":7.782},"min":{"1min":1.3200000000000001,"5min":1.29,"15min":1.226},"max":{"1min":20.303999999999998,"5min":66.25,"15min":66.25},"last":1.0900000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":10.364000000000001,"5min":12.771000000000001,"15min":9.2509999999999994},"min":{"1min":1.242,"5min":1.181,"15min":1.079},"max":{"1min":20.744,"5min":65.650000000000006,"15min":75.225999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":11.446999999999999,"5min":14.766999999999999,"15min":10.284000000000001},"min":{"1min":1.476,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":21.491,"5min":85.747,"15min":85.747},"last":1.0529999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:09 2020","interfaces":[{"interface":"back","average":{"1min":15.535,"5min":17.238,"15min":8.7699999999999996},"min":{"1min":1.601,"5min":1.2769999999999999,"15min":1.2769999999999999},"max":{"1min":37.311999999999998,"5min":66.135999999999996,"15min":66.135999999999996},"last":0.94899999999999995},{"interface":"front","average":{"1min":18.657,"5min":19.195,"15min":8.7050000000000001},"min":{"1min":1.6200000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":37.133000000000003,"5min":85.456000000000003,"15min":85.456000000000003},"last":1.179}]}]},{"osd":0,"up_from":17,"seq":73014444234,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864140,"kb_used_data":754180,"kb_used_omap":0,"kb_used_meta":109952,"kb_avail":93507700,"statfs":{"total":96636764160,"available":95751884800,"internally_reserved":0,"allocated":772280320,"data_stored":772115063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":112590848},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":7.2279999999999998,"15min":5.0069999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.53100000000000003},"max":{"1min":16.285,"5min":46.543999999999997,"15min":46.543999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":3.2719999999999998,"5min":7.3639999999999999,"15min":5.6900000000000004},"min":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.627},"max":{"1min":16.303999999999998,"5min":48.5,"15min":55.564},"last":1.268}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1759999999999999,"15min":1.1000000000000001},"min":{"1min":0.76200000000000001,"5min":0.68799999999999994,"15min":0.499},"max":{"1min":1.4810000000000001,"5min":3.8690000000000002,"15min":4.218},"last":1.125},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0509999999999999,"15min":1.0289999999999999},"min":{"1min":0.753,"5min":0.56799999999999995,"15min":0.53800000000000003},"max":{"1min":1.367,"5min":5.5209999999999999,"15min":5.5209999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":3.5489999999999999,"15min":3.3380000000000001},"min":{"1min":0.75700000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"max":{"1min":1.383,"5min":36.844999999999999,"15min":36.844999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":4.5350000000000001,"15min":3.8140000000000001},"min":{"1min":0.84699999999999998,"5min":0.81899999999999995,"15min":0.70599999999999996},"max":{"1min":1.6890000000000001,"5min":46.908000000000001,"15min":46.908000000000001},"last":1.6890000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.887,"15min":1.742},"min":{"1min":0.76300000000000001,"5min":0.73099999999999998,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":46.579000000000001,"15min":51.210999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.0449999999999999,"15min":1.9430000000000001},"min":{"1min":1.1160000000000001,"5min":0.83999999999999997,"15min":0.68300000000000005},"max":{"1min":1.623,"5min":46.078000000000003,"15min":51.238},"last":1.161}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.105,"15min":1.6359999999999999},"min":{"1min":0.97299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0510000000000002,"5min":55.969999999999999,"15min":55.969999999999999},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.329,"5min":2.1339999999999999,"15min":1.6559999999999999},"min":{"1min":0.98799999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.825,"5min":57.426000000000002,"15min":57.426000000000002},"last":1.5409999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.0880000000000001,"15min":1.6919999999999999},"min":{"1min":1.0940000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0310000000000001,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.415},{"interface":"front","average":{"1min":1.6559999999999999,"5min":2.1930000000000001,"15min":1.7889999999999999},"min":{"1min":1.2769999999999999,"5min":1.0049999999999999,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":47.027000000000001,"15min":47.027000000000001},"last":1.853}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":2.105,"15min":1.9590000000000001},"min":{"1min":1.0349999999999999,"5min":0.89600000000000002,"15min":0.65800000000000003},"max":{"1min":1.9490000000000001,"5min":47.246000000000002,"15min":50.509},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":2.262,"15min":2.165},"min":{"1min":1.2929999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2,"5min":46.308,"15min":50.698},"last":1.2929999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:44:57 2020","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.427,"15min":1.9490000000000001},"min":{"1min":1.3029999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.903,"5min":47.418999999999997,"15min":47.418999999999997},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.5409999999999999,"5min":2.3780000000000001,"15min":1.871},"min":{"1min":1.1879999999999999,"5min":0.94699999999999995,"15min":0.78600000000000003},"max":{"1min":1.857,"5min":47.543999999999997,"15min":47.543999999999997},"last":1.772}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.73,"5min":2.617,"15min":3.093},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":0.98199999999999998},"max":{"1min":2.4140000000000001,"5min":47.140000000000001,"15min":47.140000000000001},"last":2.4140000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":2.5,"15min":3.0379999999999998},"min":{"1min":1.3280000000000001,"5min":1.0640000000000001,"15min":0.95599999999999996},"max":{"1min":2.0489999999999999,"5min":46.703000000000003,"15min":46.703000000000003},"last":1.6619999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":2.4900000000000002,"15min":2.0510000000000002},"min":{"1min":1.4079999999999999,"5min":1.139,"15min":1.1160000000000001},"max":{"1min":2.1760000000000002,"5min":46.200000000000003,"15min":46.200000000000003},"last":1.526},{"interface":"front","average":{"1min":1.7,"5min":2.4769999999999999,"15min":2.0230000000000001},"min":{"1min":1.4019999999999999,"5min":1.286,"15min":1.127},"max":{"1min":2.0950000000000002,"5min":48.350000000000001,"15min":48.350000000000001},"last":2.0950000000000002}]}]},{"osd":2,"up_from":17,"seq":73014444233,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2307248,"kb_used_data":2038056,"kb_used_omap":0,"kb_used_meta":269184,"kb_avail":92064592,"statfs":{"total":96636764160,"available":94274142208,"internally_reserved":0,"allocated":2086969344,"data_stored":2086803194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":275644416},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":5.1950000000000003,"5min":11.471,"15min":5.9669999999999996},"min":{"1min":0.68799999999999994,"5min":0.628,"15min":0.625},"max":{"1min":25.548999999999999,"5min":77.983000000000004,"15min":77.983000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":6.9249999999999998,"5min":11.894,"15min":6.0330000000000004},"min":{"1min":0.65900000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":33.774999999999999,"5min":78.215000000000003,"15min":78.215000000000003},"last":2.1280000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.127,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.63200000000000001},"max":{"1min":1.198,"5min":8.3740000000000006,"15min":9.4440000000000008},"last":5.3460000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.2370000000000001,"15min":1.1699999999999999},"min":{"1min":0.68600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5269999999999999,"5min":8.2140000000000004,"15min":9.6769999999999996},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":5.2759999999999998,"15min":3.6339999999999999},"min":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.51900000000000002},"max":{"1min":5.3540000000000001,"5min":77.859999999999999,"15min":77.859999999999999},"last":2.2759999999999998},{"interface":"front","average":{"1min":1.486,"5min":6.0309999999999997,"15min":4.0389999999999997},"min":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.68000000000000005},"max":{"1min":5.431,"5min":77.891999999999996,"15min":77.891999999999996},"last":5.6390000000000002}]},{"osd":5,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.5289999999999999,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.58599999999999997},"max":{"1min":1.663,"5min":8.8469999999999995,"15min":11.797000000000001},"last":5.7679999999999998},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.667,"15min":1.627},"min":{"1min":1,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.839,"5min":10.281000000000001,"15min":10.281000000000001},"last":1.514}]},{"osd":6,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.4550000000000001,"15min":1.4239999999999999},"min":{"1min":0.78500000000000003,"5min":0.68200000000000005,"15min":0.67500000000000004},"max":{"1min":1.861,"5min":7.5339999999999998,"15min":9.3119999999999994},"last":2.762},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.748,"15min":1.615},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.73899999999999999},"max":{"1min":1.8740000000000001,"5min":11.779,"15min":11.779},"last":5.899}]},{"osd":7,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":2.5379999999999998,"15min":1.9330000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.80000000000000004},"max":{"1min":1.8129999999999999,"5min":77.819999999999993,"15min":77.819999999999993},"last":18.559000000000001},{"interface":"front","average":{"1min":1.339,"5min":2.4430000000000001,"15min":1.931},"min":{"1min":0.94499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.845,"5min":78.126999999999995,"15min":78.126999999999995},"last":31.295999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.952,"15min":1.8580000000000001},"min":{"1min":0.90100000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.1659999999999999,"5min":8.7400000000000002,"15min":11.343999999999999},"last":6.5039999999999996},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.974,"15min":2.0259999999999998},"min":{"1min":1.246,"5min":1.099,"15min":1.075},"max":{"1min":1.9870000000000001,"5min":8.6039999999999992,"15min":18.099},"last":2.3610000000000002}]},{"osd":9,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.9159999999999999,"15min":1.893},"min":{"1min":1.2589999999999999,"5min":1.083,"15min":1.0629999999999999},"max":{"1min":2.1099999999999999,"5min":8.3659999999999997,"15min":10.129},"last":2.6150000000000002},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.7609999999999999,"15min":1.7889999999999999},"min":{"1min":1.2070000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9830000000000001,"5min":7.7460000000000004,"15min":9.4220000000000006},"last":2.411}]},{"osd":10,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":3.226,"15min":2.7570000000000001},"min":{"1min":1.242,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":5.7969999999999997,"5min":78.016000000000005,"15min":78.016000000000005},"last":2.6520000000000001},{"interface":"front","average":{"1min":1.802,"5min":3.4079999999999999,"15min":2.8220000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":5.7290000000000001,"5min":77.741,"15min":77.741},"last":6.3799999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:44:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0550000000000002},"min":{"1min":1.425,"5min":1.246,"15min":1.2190000000000001},"max":{"1min":2.242,"5min":8.7319999999999993,"15min":10.26},"last":2.4969999999999999},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.9630000000000001,"15min":2.0059999999999998},"min":{"1min":1.331,"5min":1.113,"15min":1.113},"max":{"1min":2.125,"5min":8.0540000000000003,"15min":9.6440000000000001},"last":2.5230000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444233,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857832,"kb_used_data":758048,"kb_used_omap":0,"kb_used_meta":99776,"kb_avail":93514008,"statfs":{"total":96636764160,"available":95758344192,"internally_reserved":0,"allocated":776241152,"data_stored":776082619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":102170624},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Fri Nov 20 11:44:55 2020","interfaces":[{"interface":"back","average":{"1min":6.7539999999999996,"5min":11.468999999999999,"15min":5.6589999999999998},"min":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":20.856999999999999,"5min":109.33199999999999,"15min":109.33199999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":7.3620000000000001,"5min":11.717000000000001,"15min":5.8029999999999999},"min":{"1min":0.71599999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":20.893999999999998,"5min":109.303,"15min":109.303},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.97099999999999997,"15min":1.496},"min":{"1min":0.64900000000000002,"5min":0.59599999999999997,"15min":0.54900000000000004},"max":{"1min":1.4239999999999999,"5min":3.3220000000000001,"15min":80.936999999999998},"last":0.877},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.208,"15min":1.5},"min":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"max":{"1min":1.3140000000000001,"5min":8.2599999999999998,"15min":80.414000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":5.1989999999999998,"5min":5.2290000000000001,"15min":4.1050000000000004},"min":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.622},"max":{"1min":85.147999999999996,"5min":85.147999999999996,"15min":85.147999999999996},"last":1.008},{"interface":"front","average":{"1min":5.2750000000000004,"5min":5.4850000000000003,"15min":4.2290000000000001},"min":{"1min":0.70299999999999996,"5min":0.64400000000000002,"15min":0.59299999999999997},"max":{"1min":85.228999999999999,"5min":85.228999999999999,"15min":85.228999999999999},"last":1.212}]},{"osd":5,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3560000000000001,"15min":1.6679999999999999},"min":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.63300000000000001},"max":{"1min":1.724,"5min":6.9329999999999998,"15min":81.069999999999993},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2729999999999999,"15min":1.5880000000000001},"min":{"1min":0.74399999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"max":{"1min":1.603,"5min":6.6399999999999997,"15min":80.777000000000001},"last":1.373}]},{"osd":6,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3700000000000001,"15min":1.2929999999999999},"min":{"1min":0.70599999999999996,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6970000000000001,"5min":4.944,"15min":5.7060000000000004},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.5309999999999999,"15min":1.4239999999999999},"min":{"1min":0.876,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8600000000000001,"5min":10.449,"15min":10.449},"last":1.399}]},{"osd":7,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3620000000000001,"15min":1.337},"min":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66000000000000003},"max":{"1min":1.6890000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.522,"15min":1.4370000000000001},"min":{"1min":0.94699999999999995,"5min":0.81799999999999995,"15min":0.79300000000000004},"max":{"1min":2.073,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":1.4370000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5880000000000001,"15min":1.9370000000000001},"min":{"1min":1.024,"5min":0.94999999999999996,"15min":0.82199999999999995},"max":{"1min":1.9850000000000001,"5min":4.2190000000000003,"15min":80.457999999999998},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6279999999999999,"15min":1.9750000000000001},"min":{"1min":1.05,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8180000000000001,"5min":8.1500000000000004,"15min":82.094999999999999},"last":1.619}]},{"osd":9,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6419999999999999,"15min":1.659},"min":{"1min":1.093,"5min":0.98599999999999999,"15min":0.94199999999999995},"max":{"1min":2.0009999999999999,"5min":6.048,"15min":7.6509999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.6919999999999999,"15min":1.7290000000000001},"min":{"1min":1.3320000000000001,"5min":0.90900000000000003,"15min":0.84799999999999998},"max":{"1min":2.1040000000000001,"5min":4.3949999999999996,"15min":7.8940000000000001},"last":1.54}]},{"osd":10,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":2.0800000000000001,"15min":2.5089999999999999},"min":{"1min":1.2330000000000001,"5min":1.0780000000000001,"15min":1.048},"max":{"1min":6.125,"5min":16.952999999999999,"15min":21.556000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.671,"5min":1.9450000000000001,"15min":2.508},"min":{"1min":1.321,"5min":1.2470000000000001,"15min":1.1140000000000001},"max":{"1min":2.226,"5min":8.7739999999999991,"15min":22.158999999999999},"last":1.663}]},{"osd":11,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.766,"15min":2.093},"min":{"1min":1.1259999999999999,"5min":1.0620000000000001,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":8.4969999999999999,"15min":81.783000000000001},"last":1.74},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.895,"15min":2.153},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":1.117},"max":{"1min":2.198,"5min":7.1210000000000004,"15min":81.853999999999999},"last":1.7569999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444233,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3146024,"kb_used_data":2773344,"kb_used_omap":0,"kb_used_meta":350144,"kb_avail":91225816,"statfs":{"total":96636764160,"available":93415235584,"internally_reserved":0,"allocated":2839904256,"data_stored":2839745723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":358547456},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,2,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":2.4350000000000001,"15min":2.5779999999999998},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.325,"5min":28.654,"15min":30.84},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":2.5880000000000001,"15min":2.3799999999999999},"min":{"1min":0.65000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5700000000000001,"5min":28.18,"15min":31.724},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":8.0199999999999996,"5min":13.227,"15min":8.9049999999999994},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.64700000000000002},"max":{"1min":37.325000000000003,"5min":55.183999999999997,"15min":59.253},"last":1.8029999999999999},{"interface":"front","average":{"1min":8.1029999999999998,"5min":13.624000000000001,"15min":10.289999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.61699999999999999},"max":{"1min":37.371000000000002,"5min":55.234999999999999,"15min":171.99199999999999},"last":5.0949999999999998}]},{"osd":3,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":2.2949999999999999,"15min":2.859},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"max":{"1min":2.302,"5min":19.934999999999999,"15min":31.109000000000002},"last":2.302},{"interface":"front","average":{"1min":1.1160000000000001,"5min":3.956,"15min":3.6259999999999999},"min":{"1min":0.82599999999999996,"5min":0.68000000000000005,"15min":0.67300000000000004},"max":{"1min":1.726,"5min":37.377000000000002,"15min":37.377000000000002},"last":1.2749999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":3.081,"15min":3.214},"min":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.5670000000000002,"5min":28.321000000000002,"15min":32.130000000000003},"last":1.448},{"interface":"front","average":{"1min":1.379,"5min":2.5819999999999999,"15min":3.7349999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.5390000000000001,"5min":25.385000000000002,"15min":31.341000000000001},"last":2.5390000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.0099999999999998,"15min":4.6829999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.66500000000000004},"max":{"1min":2.0329999999999999,"5min":44.808999999999997,"15min":62.055},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":4.758,"15min":4.0759999999999996},"min":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.464,"5min":44.914999999999999,"15min":61.060000000000002},"last":1.571}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":4.8559999999999999,"15min":4.7000000000000002},"min":{"1min":0.79400000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.9870000000000001,"5min":44.597000000000001,"15min":45.829999999999998},"last":4.9870000000000001},{"interface":"front","average":{"1min":1.76,"5min":6.2519999999999998,"15min":4.7720000000000002},"min":{"1min":0.95899999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":6.4699999999999998,"5min":54.201000000000001,"15min":54.201000000000001},"last":6.4699999999999998}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":7.1989999999999998,"15min":5.367},"min":{"1min":1.0309999999999999,"5min":0.878,"15min":0.878},"max":{"1min":2.5659999999999998,"5min":44.716000000000001,"15min":44.716000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.847,"5min":4.8700000000000001,"15min":4.8129999999999997},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.7489999999999997,"5min":44.753,"15min":44.753},"last":4.7489999999999997}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":5.1970000000000001,"15min":4.1280000000000001},"min":{"1min":1.032,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.669,"5min":44.639000000000003,"15min":44.639000000000003},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":6.0030000000000001,"15min":5.2770000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.423,"5min":45.015999999999998,"15min":45.015999999999998},"last":2.423}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":8.5739999999999998,"15min":7.6470000000000002},"min":{"1min":1.147,"5min":1.147,"15min":1.1339999999999999},"max":{"1min":4.0099999999999998,"5min":44.954000000000001,"15min":45.936},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.8169999999999999,"5min":6.6239999999999997,"15min":6.7519999999999998},"min":{"1min":1.1399999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.0309999999999997,"5min":44.784999999999997,"15min":50.340000000000003},"last":1.954}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":6.0190000000000001,"15min":5.4640000000000004},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":4.8710000000000004,"5min":44.881999999999998,"15min":44.881999999999998},"last":4.8710000000000004},{"interface":"front","average":{"1min":1.665,"5min":8.1489999999999991,"15min":6.048},"min":{"1min":1.208,"5min":1.093,"15min":1.093},"max":{"1min":2.2919999999999998,"5min":53.826999999999998,"15min":53.826999999999998},"last":1.6240000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444233,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1539944,"kb_used_data":1347872,"kb_used_omap":0,"kb_used_meta":192064,"kb_avail":92831896,"statfs":{"total":96636764160,"available":95059861504,"internally_reserved":0,"allocated":1380220928,"data_stored":1380062395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":196673536},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.101,"15min":1.0580000000000001},"min":{"1min":0.65400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2929999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.089,"15min":1.0549999999999999},"min":{"1min":0.65100000000000002,"5min":0.62,"15min":0.60699999999999998},"max":{"1min":1.234,"5min":5.665,"15min":5.665},"last":0.877}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":7.9820000000000002,"15min":6.2060000000000004},"min":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.63500000000000001},"max":{"1min":14.426,"5min":37.024999999999999,"15min":95.546999999999997},"last":0.84499999999999997},{"interface":"front","average":{"1min":3.0659999999999998,"5min":7.8879999999999999,"15min":5.9630000000000001},"min":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":14.476000000000001,"5min":38.518000000000001,"15min":94.667000000000002},"last":1.123}]},{"osd":2,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.613,"15min":1.4990000000000001},"min":{"1min":0.68500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.647,"5min":22.68,"15min":22.68},"last":1.288},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.552,"15min":1.371},"min":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.64400000000000002},"max":{"1min":1.3700000000000001,"5min":28.699999999999999,"15min":28.699999999999999},"last":1.1699999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":3.1179999999999999,"15min":4.0350000000000001},"min":{"1min":0.90500000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.992,"5min":19.047999999999998,"15min":92.614999999999995},"last":1.992},{"interface":"front","average":{"1min":1.286,"5min":3.0830000000000002,"15min":4.2560000000000002},"min":{"1min":1.0780000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.657,"5min":18.266999999999999,"15min":93.894000000000005},"last":1.4199999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.6679999999999999,"15min":1.657},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.629},"max":{"1min":2.1389999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.405,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":1.026,"5min":1.006,"15min":0.91000000000000003},"max":{"1min":1.788,"5min":10.125,"15min":10.125},"last":1.536}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.593,"15min":1.601},"min":{"1min":0.96999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7070000000000001,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":1.702},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.841,"15min":1.867},"min":{"1min":1.161,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.2559999999999998,"5min":10.981999999999999,"15min":10.981999999999999},"last":2.2559999999999998}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1349999999999998},"min":{"1min":1.302,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.3279999999999998,"5min":9.8010000000000002,"15min":45.292999999999999},"last":2.3279999999999998},{"interface":"front","average":{"1min":1.623,"5min":2.0409999999999999,"15min":2.2389999999999999},"min":{"1min":1.3340000000000001,"5min":1.1830000000000001,"15min":1.0660000000000001},"max":{"1min":1.966,"5min":10.221,"15min":45.390000000000001},"last":1.966}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.9590000000000001,"15min":2.0880000000000001},"min":{"1min":1.3720000000000001,"5min":1.3180000000000001,"15min":1.202},"max":{"1min":2.056,"5min":9.9979999999999993,"15min":45.686999999999998},"last":1.643},{"interface":"front","average":{"1min":1.395,"5min":1.774,"15min":1.758},"min":{"1min":1.169,"5min":1.0760000000000001,"15min":0.93799999999999994},"max":{"1min":1.7509999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":1.446}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.9790000000000001,"15min":3.4340000000000002},"min":{"1min":1.276,"5min":1.153,"15min":1.103},"max":{"1min":2.5539999999999998,"5min":8.7330000000000005,"15min":96.786000000000001},"last":2.5539999999999998},{"interface":"front","average":{"1min":1.661,"5min":2.105,"15min":3.5550000000000002},"min":{"1min":1.331,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.3999999999999999,"5min":10.847,"15min":95.569999999999993},"last":2.3999999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":2.1509999999999998,"15min":2.2490000000000001},"min":{"1min":1.419,"5min":1.3680000000000001,"15min":1.1990000000000001},"max":{"1min":2.1859999999999999,"5min":15.747,"15min":45.524000000000001},"last":1.756},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.9650000000000001,"15min":2.137},"min":{"1min":1.3560000000000001,"5min":1.1679999999999999,"15min":1.163},"max":{"1min":1.8740000000000001,"5min":9.843,"15min":45.317999999999998},"last":1.5740000000000001}]}]}]}} 2020-11-20T11:45:56.171 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:45:56.351 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.347+0000 7f72da796700 1 Processor -- start 2020-11-20T11:45:56.351 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.347+0000 7f72da796700 1 -- start start 2020-11-20T11:45:56.360 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72da796700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72d40bab60 0x7f72d40baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:56.361 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72da796700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40bd4a0 con 0x7f72d40667b0 2020-11-20T11:45:56.361 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72da796700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40be370 con 0x7f72d40bc730 2020-11-20T11:45:56.361 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72da796700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d40bced0 con 0x7f72d40bab60 2020-11-20T11:45:56.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72d37fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f72d40bc730 0x7f72d405ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41896/0 (socket says 172.21.15.105:41896) 2020-11-20T11:45:56.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72d37fe700 1 -- 172.21.15.105:0/2829252823 learned_addr learned my addr 172.21.15.105:0/2829252823 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:56.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72d3fff700 1 --2- 172.21.15.105:0/2829252823 >> v2:172.21.15.67:3300/0 conn(0x7f72d40bab60 0x7f72d40baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:56.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.348+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294379172 0 0) 0x7f72d40be370 con 0x7f72d40bc730 2020-11-20T11:45:56.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0003240 con 0x7f72d40bc730 2020-11-20T11:45:56.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d3fff700 1 -- 172.21.15.105:0/2829252823 >> v1:172.21.15.105:6789/0 conn(0x7f72d40bc730 legacy=0x7f72d405ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d3fff700 1 -- 172.21.15.105:0/2829252823 >> v1:172.21.15.67:6789/0 conn(0x7f72d40667b0 legacy=0x7f72d4066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347468821 0 0) 0x7f72d40bd4a0 con 0x7f72d40667b0 2020-11-20T11:45:56.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d3fff700 1 -- 172.21.15.105:0/2829252823 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40bd6f0 con 0x7f72d40bab60 2020-11-20T11:45:56.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d3fff700 1 --2- 172.21.15.105:0/2829252823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bab60 0x7f72d40baf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f72c400b9a0 tx=0x7f72c4006df0).ready entity=mon.0 client_cookie=d51e774ab1dd47c7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:56.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40097b0 con 0x7f72d40bab60 2020-11-20T11:45:56.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4009910 con 0x7f72d40bab60 2020-11-20T11:45:56.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.349+0000 7f72d2ffd700 1 -- 172.21.15.105:0/2829252823 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4009c90 con 0x7f72d40bab60 2020-11-20T11:45:56.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 -- 172.21.15.105:0/2829252823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bab60 msgr2=0x7f72d40baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.367 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 --2- 172.21.15.105:0/2829252823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bab60 0x7f72d40baf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f72c400b9a0 tx=0x7f72c4006df0).stop 2020-11-20T11:45:56.367 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 -- 172.21.15.105:0/2829252823 shutdown_connections 2020-11-20T11:45:56.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 --2- 172.21.15.105:0/2829252823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bab60 0x7f72d40baf40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 -- 172.21.15.105:0/2829252823 >> 172.21.15.105:0/2829252823 conn(0x7f72d4060bc0 msgr2=0x7f72d40c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:56.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 -- 172.21.15.105:0/2829252823 shutdown_connections 2020-11-20T11:45:56.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.350+0000 7f72da796700 1 -- 172.21.15.105:0/2829252823 wait complete. 2020-11-20T11:45:56.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.351+0000 7f72da796700 1 Processor -- start 2020-11-20T11:45:56.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.351+0000 7f72da796700 1 -- start start 2020-11-20T11:45:56.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 0x7f72d4151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:56.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:56.370 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 0x7f72d40c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:56.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4154000 con 0x7f72d40bc730 2020-11-20T11:45:56.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d41542a0 con 0x7f72d40667b0 2020-11-20T11:45:56.371 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72da796700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4152680 con 0x7f72d40bab60 2020-11-20T11:45:56.372 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72d37fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:56.372 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72d37fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42300/0 (socket says 172.21.15.105:42300) 2020-11-20T11:45:56.372 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72d37fe700 1 -- 172.21.15.105:0/826258310 learned_addr learned my addr 172.21.15.105:0/826258310 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:56.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72d3fff700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 0x7f72d4151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:56.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.352+0000 7f72d8d33700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 0x7f72d40c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:56.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 -- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 msgr2=0x7f72d4151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 0x7f72d4151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.374 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 -- 172.21.15.105:0/826258310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 msgr2=0x7f72d40c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 0x7f72d40c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 -- 172.21.15.105:0/826258310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4152920 con 0x7f72d40bab60 2020-11-20T11:45:56.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d8d33700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 0x7f72d40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:56.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d3fff700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 0x7f72d4151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:56.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72d37fe700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f72c800c710 tx=0x7f72c8007aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:56.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80072e0 con 0x7f72d40bab60 2020-11-20T11:45:56.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8007440 con 0x7f72d40bab60 2020-11-20T11:45:56.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d4152bc0 con 0x7f72d40bab60 2020-11-20T11:45:56.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8005800 con 0x7f72d40bab60 2020-11-20T11:45:56.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.353+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d4153be0 con 0x7f72d40bab60 2020-11-20T11:45:56.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.354+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d4153020 con 0x7f72d40bab60 2020-11-20T11:45:56.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.355+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f72c8010070 con 0x7f72d40bab60 2020-11-20T11:45:56.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.355+0000 7f72b3fff700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 0x7f72ac082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:56.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.355+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f72c80a21e0 con 0x7f72d40bab60 2020-11-20T11:45:56.380 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.355+0000 7f72d3fff700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 0x7f72ac082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:56.380 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.356+0000 7f72d3fff700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 0x7f72ac082b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f72c4006e30 tx=0x7f72c4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:56.381 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.361+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f72c8076bf0 con 0x7f72d40bab60 2020-11-20T11:45:56.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.575+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72d4044f60 con 0x7f72d40bab60 2020-11-20T11:45:56.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.576+0000 7f72b3fff700 1 -- 172.21.15.105:0/826258310 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f72c8007be0 con 0x7f72d40bab60 2020-11-20T11:45:56.581 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:45:56.581 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":28,"fsid":"6db90bc8-73b8-4163-bb1f-2d88eda44265","created":"2020-11-20T11:29:07.808432+0000","modified":"2020-11-20T11:29:32.163910+0000","last_up_change":"2020-11-20T11:29:16.211491+0000","last_in_change":"2020-11-20T11:29:16.211491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:29:11.234336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:29:24.196669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:29:27.352951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:29:29.818965+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28d43528-bc7d-4336-babc-9ce77f2ae383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24840},{"type":"v1","addr":"172.21.15.105:6801","nonce":24840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24840},{"type":"v1","addr":"172.21.15.105:6803","nonce":24840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24840},{"type":"v1","addr":"172.21.15.105:6807","nonce":24840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24840},{"type":"v1","addr":"172.21.15.105:6805","nonce":24840}]},"public_addr":"172.21.15.105:6801/24840","cluster_addr":"172.21.15.105:6803/24840","heartbeat_back_addr":"172.21.15.105:6807/24840","heartbeat_front_addr":"172.21.15.105:6805/24840","state":["exists","up"]},{"osd":1,"uuid":"0b365517-f0cd-4335-93eb-fa43988e7352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":24705},{"type":"v1","addr":"172.21.15.100:6803","nonce":24705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":24705},{"type":"v1","addr":"172.21.15.100:6805","nonce":24705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":24705},{"type":"v1","addr":"172.21.15.100:6809","nonce":24705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":24705},{"type":"v1","addr":"172.21.15.100:6807","nonce":24705}]},"public_addr":"172.21.15.100:6803/24705","cluster_addr":"172.21.15.100:6805/24705","heartbeat_back_addr":"172.21.15.100:6809/24705","heartbeat_front_addr":"172.21.15.100:6807/24705","state":["exists","up"]},{"osd":2,"uuid":"1ab5b2be-91c2-49b4-ac74-3c03369154f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":25159},{"type":"v1","addr":"172.21.15.67:6825","nonce":25159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":25159},{"type":"v1","addr":"172.21.15.67:6827","nonce":25159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":25159},{"type":"v1","addr":"172.21.15.67:6831","nonce":25159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":25159},{"type":"v1","addr":"172.21.15.67:6829","nonce":25159}]},"public_addr":"172.21.15.67:6825/25159","cluster_addr":"172.21.15.67:6827/25159","heartbeat_back_addr":"172.21.15.67:6831/25159","heartbeat_front_addr":"172.21.15.67:6829/25159","state":["exists","up"]},{"osd":3,"uuid":"c357fd9e-720f-4506-be55-66203d14795f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24841},{"type":"v1","addr":"172.21.15.105:6809","nonce":24841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24841},{"type":"v1","addr":"172.21.15.105:6811","nonce":24841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24841},{"type":"v1","addr":"172.21.15.105:6819","nonce":24841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24841},{"type":"v1","addr":"172.21.15.105:6814","nonce":24841}]},"public_addr":"172.21.15.105:6809/24841","cluster_addr":"172.21.15.105:6811/24841","heartbeat_back_addr":"172.21.15.105:6819/24841","heartbeat_front_addr":"172.21.15.105:6814/24841","state":["exists","up"]},{"osd":4,"uuid":"6a97c7c7-350b-45a5-8edc-814ed52b9075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":24706},{"type":"v1","addr":"172.21.15.100:6812","nonce":24706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":24706},{"type":"v1","addr":"172.21.15.100:6816","nonce":24706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":24706},{"type":"v1","addr":"172.21.15.100:6824","nonce":24706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":24706},{"type":"v1","addr":"172.21.15.100:6820","nonce":24706}]},"public_addr":"172.21.15.100:6812/24706","cluster_addr":"172.21.15.100:6816/24706","heartbeat_back_addr":"172.21.15.100:6824/24706","heartbeat_front_addr":"172.21.15.100:6820/24706","state":["exists","up"]},{"osd":5,"uuid":"82292b9b-38f8-4a3b-adad-4b2973cff1e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":25148},{"type":"v1","addr":"172.21.15.67:6809","nonce":25148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":25148},{"type":"v1","addr":"172.21.15.67:6811","nonce":25148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":25148},{"type":"v1","addr":"172.21.15.67:6815","nonce":25148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":25148},{"type":"v1","addr":"172.21.15.67:6813","nonce":25148}]},"public_addr":"172.21.15.67:6809/25148","cluster_addr":"172.21.15.67:6811/25148","heartbeat_back_addr":"172.21.15.67:6815/25148","heartbeat_front_addr":"172.21.15.67:6813/25148","state":["exists","up"]},{"osd":6,"uuid":"fa80daf6-1797-44dc-8250-13bc57cca5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6813","nonce":24842},{"type":"v1","addr":"172.21.15.105:6815","nonce":24842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":24842},{"type":"v1","addr":"172.21.15.105:6818","nonce":24842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24842},{"type":"v1","addr":"172.21.15.105:6823","nonce":24842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24842},{"type":"v1","addr":"172.21.15.105:6821","nonce":24842}]},"public_addr":"172.21.15.105:6815/24842","cluster_addr":"172.21.15.105:6818/24842","heartbeat_back_addr":"172.21.15.105:6823/24842","heartbeat_front_addr":"172.21.15.105:6821/24842","state":["exists","up"]},{"osd":7,"uuid":"8c824435-0b62-404e-ac4f-ace3021c8d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":24707},{"type":"v1","addr":"172.21.15.100:6813","nonce":24707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":24707},{"type":"v1","addr":"172.21.15.100:6817","nonce":24707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":24707},{"type":"v1","addr":"172.21.15.100:6825","nonce":24707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":24707},{"type":"v1","addr":"172.21.15.100:6821","nonce":24707}]},"public_addr":"172.21.15.100:6813/24707","cluster_addr":"172.21.15.100:6817/24707","heartbeat_back_addr":"172.21.15.100:6825/24707","heartbeat_front_addr":"172.21.15.100:6821/24707","state":["exists","up"]},{"osd":8,"uuid":"94f71992-cb21-4ce6-85b6-a8f9d04cbfef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":25152},{"type":"v1","addr":"172.21.15.67:6817","nonce":25152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":25152},{"type":"v1","addr":"172.21.15.67:6819","nonce":25152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":25152},{"type":"v1","addr":"172.21.15.67:6823","nonce":25152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":25152},{"type":"v1","addr":"172.21.15.67:6821","nonce":25152}]},"public_addr":"172.21.15.67:6817/25152","cluster_addr":"172.21.15.67:6819/25152","heartbeat_back_addr":"172.21.15.67:6823/25152","heartbeat_front_addr":"172.21.15.67:6821/25152","state":["exists","up"]},{"osd":9,"uuid":"a0e37a56-69a2-40a9-b41b-45b4a78c33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24843},{"type":"v1","addr":"172.21.15.105:6825","nonce":24843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24843},{"type":"v1","addr":"172.21.15.105:6827","nonce":24843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24843},{"type":"v1","addr":"172.21.15.105:6831","nonce":24843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24843},{"type":"v1","addr":"172.21.15.105:6829","nonce":24843}]},"public_addr":"172.21.15.105:6825/24843","cluster_addr":"172.21.15.105:6827/24843","heartbeat_back_addr":"172.21.15.105:6831/24843","heartbeat_front_addr":"172.21.15.105:6829/24843","state":["exists","up"]},{"osd":10,"uuid":"fbedbd4f-e258-4b85-a402-39224f5f7eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":24710},{"type":"v1","addr":"172.21.15.100:6827","nonce":24710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":24710},{"type":"v1","addr":"172.21.15.100:6829","nonce":24710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":24710},{"type":"v1","addr":"172.21.15.100:6833","nonce":24710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":24710},{"type":"v1","addr":"172.21.15.100:6831","nonce":24710}]},"public_addr":"172.21.15.100:6827/24710","cluster_addr":"172.21.15.100:6829/24710","heartbeat_back_addr":"172.21.15.100:6833/24710","heartbeat_front_addr":"172.21.15.100:6831/24710","state":["exists","up"]},{"osd":11,"uuid":"1a3c1bdf-8b24-456f-ae61-0c982d2c21dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":25149},{"type":"v1","addr":"172.21.15.67:6801","nonce":25149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":25149},{"type":"v1","addr":"172.21.15.67:6803","nonce":25149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":25149},{"type":"v1","addr":"172.21.15.67:6807","nonce":25149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":25149},{"type":"v1","addr":"172.21.15.67:6805","nonce":25149}]},"public_addr":"172.21.15.67:6801/25149","cluster_addr":"172.21.15.67:6803/25149","heartbeat_back_addr":"172.21.15.67:6807/25149","heartbeat_front_addr":"172.21.15.67:6805/25149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.742343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.696026+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.703565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.795346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.772291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.680431+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.726239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.791112+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.778416+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.768953+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:29:14.775754+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:45:56.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 msgr2=0x7f72ac082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 0x7f72ac082b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f72c4006e30 tx=0x7f72c4017000).stop 2020-11-20T11:45:56.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 msgr2=0x7f72d40c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:56.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f72c800c710 tx=0x7f72c8007aa0).stop 2020-11-20T11:45:56.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 shutdown_connections 2020-11-20T11:45:56.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d40bc730 0x7f72d40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d40667b0 0x7f72d4151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f72ac080660 0x7f72ac082b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 --2- 172.21.15.105:0/826258310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72d40bab60 0x7f72d40c0d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:56.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 >> 172.21.15.105:0/826258310 conn(0x7f72d4060bc0 msgr2=0x7f72d41471f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:56.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 shutdown_connections 2020-11-20T11:45:56.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:56.578+0000 7f72da796700 1 -- 172.21.15.105:0/826258310 wait complete. 2020-11-20T11:45:57.594 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T11:45:57.595 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:45:57.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.764+0000 7f4034a0e700 1 Processor -- start 2020-11-20T11:45:57.768 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4034a0e700 1 -- start start 2020-11-20T11:45:57.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4034a0e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40300627d0 0x7f403005bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4034a0e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4030151830 con 0x7f40300623f0 2020-11-20T11:45:57.770 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4034a0e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403005c100 con 0x7f4030067430 2020-11-20T11:45:57.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4034a0e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4030151a60 con 0x7f40300627d0 2020-11-20T11:45:57.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.765+0000 7f4027fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40300627d0 0x7f403005bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402ed9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4030067430 0x7f4030151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41912/0 (socket says 172.21.15.105:41912) 2020-11-20T11:45:57.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402ed9d700 1 -- 172.21.15.105:0/1093890287 learned_addr learned my addr 172.21.15.105:0/1093890287 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:57.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f4027fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40300627d0 0x7f403005bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42310/0 (socket says 172.21.15.105:42310) 2020-11-20T11:45:57.772 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402e59c700 1 --1- 172.21.15.105:0/1093890287 >> v1:172.21.15.100:6789/0 conn(0x7f40300623f0 0x7f40301525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60926/0 (socket says 172.21.15.105:60926) 2020-11-20T11:45:57.772 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f4027fff700 1 -- 172.21.15.105:0/1093890287 >> v1:172.21.15.105:6789/0 conn(0x7f4030067430 legacy=0x7f4030151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.772 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f4027fff700 1 -- 172.21.15.105:0/1093890287 >> v1:172.21.15.100:6789/0 conn(0x7f40300623f0 legacy=0x7f40301525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.772 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f4027fff700 1 -- 172.21.15.105:0/1093890287 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030151d00 con 0x7f40300627d0 2020-11-20T11:45:57.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f4027fff700 1 --2- 172.21.15.105:0/1093890287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f403005bc10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f401800b9d0 tx=0x7f4018006df0).ready entity=mon.2 client_cookie=7f790fc44c11e74d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402dd9b700 1 -- 172.21.15.105:0/1093890287 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180098c0 con 0x7f40300627d0 2020-11-20T11:45:57.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402dd9b700 1 -- 172.21.15.105:0/1093890287 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018009a20 con 0x7f40300627d0 2020-11-20T11:45:57.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.766+0000 7f402dd9b700 1 -- 172.21.15.105:0/1093890287 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018009da0 con 0x7f40300627d0 2020-11-20T11:45:57.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.767+0000 7f4034a0e700 1 -- 172.21.15.105:0/1093890287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 msgr2=0x7f403005bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.767+0000 7f4034a0e700 1 --2- 172.21.15.105:0/1093890287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f403005bc10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f401800b9d0 tx=0x7f4018006df0).stop 2020-11-20T11:45:57.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.768+0000 7f4034a0e700 1 -- 172.21.15.105:0/1093890287 shutdown_connections 2020-11-20T11:45:57.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.768+0000 7f4034a0e700 1 --2- 172.21.15.105:0/1093890287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f403005bc10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.768+0000 7f4034a0e700 1 -- 172.21.15.105:0/1093890287 >> 172.21.15.105:0/1093890287 conn(0x7f40300c3cd0 msgr2=0x7f40300c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:57.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.768+0000 7f4034a0e700 1 -- 172.21.15.105:0/1093890287 shutdown_connections 2020-11-20T11:45:57.777 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.768+0000 7f4034a0e700 1 -- 172.21.15.105:0/1093890287 wait complete. 2020-11-20T11:45:57.778 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 Processor -- start 2020-11-20T11:45:57.778 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 -- start start 2020-11-20T11:45:57.778 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40300623f0 0x7f4030164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.778 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f4030156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.778 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4030067430 0x7f40300be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030164c60 con 0x7f40300623f0 2020-11-20T11:45:57.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030156600 con 0x7f4030067430 2020-11-20T11:45:57.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.769+0000 7f4034a0e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300c1110 con 0x7f40300627d0 2020-11-20T11:45:57.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f4030156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f4030156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42314/0 (socket says 172.21.15.105:42314) 2020-11-20T11:45:57.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 -- 172.21.15.105:0/2622121421 learned_addr learned my addr 172.21.15.105:0/2622121421 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:57.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f402e59c700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40300623f0 0x7f4030164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f402ed9d700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4030067430 0x7f40300be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 -- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4030067430 msgr2=0x7f40300be5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4030067430 0x7f40300be5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 -- 172.21.15.105:0/2622121421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40300623f0 msgr2=0x7f4030164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40300623f0 0x7f4030164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300c13b0 con 0x7f40300627d0 2020-11-20T11:45:57.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4027fff700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f4030156110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4018006fd0 tx=0x7f4018015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401801e460 con 0x7f40300627d0 2020-11-20T11:45:57.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401801e5c0 con 0x7f40300627d0 2020-11-20T11:45:57.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030155730 con 0x7f40300627d0 2020-11-20T11:45:57.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401801e940 con 0x7f40300627d0 2020-11-20T11:45:57.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.770+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4030155c70 con 0x7f40300627d0 2020-11-20T11:45:57.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.771+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4030044f60 con 0x7f40300627d0 2020-11-20T11:45:57.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.772+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4018025030 con 0x7f40300627d0 2020-11-20T11:45:57.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.772+0000 7f40267fc700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f400c080630 0x7f400c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.772+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f40180a4340 con 0x7f40300627d0 2020-11-20T11:45:57.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f402e59c700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f400c080630 0x7f400c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f40267fc700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f400c0893e0 0x7f400c08b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f400c08be60 con 0x7f400c0893e0 2020-11-20T11:45:57.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40180a6820 con 0x7f40300627d0 2020-11-20T11:45:57.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f402ed9d700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f400c0893e0 0x7f400c08b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f402e59c700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f400c080630 0x7f400c082af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4020000bc0 tx=0x7f4020007b40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.773+0000 7f402ed9d700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f400c0893e0 0x7f400c08b800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.786 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.774+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== osd.0 v2:172.21.15.105:6800/24840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f400c08be60 con 0x7f400c0893e0 2020-11-20T11:45:57.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 --> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4030155e30 con 0x7f400c0893e0 2020-11-20T11:45:57.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f40267fc700 1 -- 172.21.15.105:0/2622121421 <== osd.0 v2:172.21.15.105:6800/24840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4030155e30 con 0x7f400c0893e0 2020-11-20T11:45:57.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f400c0893e0 msgr2=0x7f400c08b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:6800/24840,v1:172.21.15.105:6801/24840] conn(0x7f400c0893e0 0x7f400c08b800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f400c080630 msgr2=0x7f400c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f400c080630 0x7f400c082af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4020000bc0 tx=0x7f4020007b40).stop 2020-11-20T11:45:57.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 msgr2=0x7f4030156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f4034a0e700 1 --2- 172.21.15.105:0/2622121421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40300627d0 0x7f4030156110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4018006fd0 tx=0x7f4018015000).stop 2020-11-20T11:45:57.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.790+0000 7f402ed9d700 1 -- 172.21.15.105:0/2622121421 reap_dead start 2020-11-20T11:45:57.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.791+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 shutdown_connections 2020-11-20T11:45:57.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.791+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 >> 172.21.15.105:0/2622121421 conn(0x7f40300c3cd0 msgr2=0x7f40300c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:57.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.791+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 shutdown_connections 2020-11-20T11:45:57.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.791+0000 7f4034a0e700 1 -- 172.21.15.105:0/2622121421 wait complete. 2020-11-20T11:45:57.797 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:45:57.797 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:45:57.797 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:45:57.805 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T11:45:57.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.936+0000 7f62a9dee700 1 Processor -- start 2020-11-20T11:45:57.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.936+0000 7f62a9dee700 1 -- start start 2020-11-20T11:45:57.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a9dee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62a40bdda0 0x7f62a4062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a9dee700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40bfc10 con 0x7f62a414b390 2020-11-20T11:45:57.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a9dee700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a414e6e0 con 0x7f62a414b770 2020-11-20T11:45:57.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a9dee700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a414eec0 con 0x7f62a40bdda0 2020-11-20T11:45:57.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a3fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62a40bdda0 0x7f62a4062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a2ffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f62a414b770 0x7f62a40c05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41926/0 (socket says 172.21.15.105:41926) 2020-11-20T11:45:57.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.937+0000 7f62a2ffd700 1 -- 172.21.15.105:0/2902568805 learned_addr learned my addr 172.21.15.105:0/2902568805 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:57.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a3fff700 1 -- 172.21.15.105:0/2902568805 >> v1:172.21.15.105:6789/0 conn(0x7f62a414b770 legacy=0x7f62a40c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a3fff700 1 -- 172.21.15.105:0/2902568805 >> v1:172.21.15.100:6789/0 conn(0x7f62a414b390 legacy=0x7f62a414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a27fc700 1 -- 172.21.15.105:0/2902568805 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151647272 0 0) 0x7f62a414e6e0 con 0x7f62a414b770 2020-11-20T11:45:57.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a3fff700 1 -- 172.21.15.105:0/2902568805 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a414e980 con 0x7f62a40bdda0 2020-11-20T11:45:57.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a3fff700 1 --2- 172.21.15.105:0/2902568805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40bdda0 0x7f62a4062780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f629c009c90 tx=0x7f629c0091d0).ready entity=mon.2 client_cookie=17b3351e8dfc5047 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a27fc700 1 -- 172.21.15.105:0/2902568805 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00bbc0 con 0x7f62a40bdda0 2020-11-20T11:45:57.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a27fc700 1 -- 172.21.15.105:0/2902568805 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c00bd20 con 0x7f62a40bdda0 2020-11-20T11:45:57.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a27fc700 1 -- 172.21.15.105:0/2902568805 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011610 con 0x7f62a40bdda0 2020-11-20T11:45:57.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 -- 172.21.15.105:0/2902568805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40bdda0 msgr2=0x7f62a4062780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 --2- 172.21.15.105:0/2902568805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40bdda0 0x7f62a4062780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f629c009c90 tx=0x7f629c0091d0).stop 2020-11-20T11:45:57.946 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 -- 172.21.15.105:0/2902568805 shutdown_connections 2020-11-20T11:45:57.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 --2- 172.21.15.105:0/2902568805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40bdda0 0x7f62a4062780 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 -- 172.21.15.105:0/2902568805 >> 172.21.15.105:0/2902568805 conn(0x7f62a40b9910 msgr2=0x7f62a40b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:57.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 -- 172.21.15.105:0/2902568805 shutdown_connections 2020-11-20T11:45:57.947 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.938+0000 7f62a9dee700 1 -- 172.21.15.105:0/2902568805 wait complete. 2020-11-20T11:45:57.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.939+0000 7f62a9dee700 1 Processor -- start 2020-11-20T11:45:57.948 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.939+0000 7f62a9dee700 1 -- start start 2020-11-20T11:45:57.950 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a40bdda0 0x7f62a41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a414b390 0x7f62a40bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a414bcf0 con 0x7f62a414b390 2020-11-20T11:45:57.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a414bf90 con 0x7f62a40bdda0 2020-11-20T11:45:57.951 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a9dee700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a414c230 con 0x7f62a414b770 2020-11-20T11:45:57.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42330/0 (socket says 172.21.15.105:42330) 2020-11-20T11:45:57.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a3fff700 1 -- 172.21.15.105:0/1206124834 learned_addr learned my addr 172.21.15.105:0/1206124834 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:57.952 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a37fe700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a40bdda0 0x7f62a41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.940+0000 7f62a2ffd700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a414b390 0x7f62a40bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 -- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a40bdda0 msgr2=0x7f62a41531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a40bdda0 0x7f62a41531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 -- 172.21.15.105:0/1206124834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a414b390 msgr2=0x7f62a40bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:57.953 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a414b390 0x7f62a40bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:57.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 -- 172.21.15.105:0/1206124834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a414c4d0 con 0x7f62a414b770 2020-11-20T11:45:57.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a3fff700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f629c009e70 tx=0x7f629c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011e30 con 0x7f62a414b770 2020-11-20T11:45:57.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c010ae0 con 0x7f62a414b770 2020-11-20T11:45:57.954 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a414c770 con 0x7f62a414b770 2020-11-20T11:45:57.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c010e60 con 0x7f62a414b770 2020-11-20T11:45:57.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.941+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a40c4260 con 0x7f62a414b770 2020-11-20T11:45:57.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.942+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4044f60 con 0x7f62a414b770 2020-11-20T11:45:57.955 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.943+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f629c017070 con 0x7f62a414b770 2020-11-20T11:45:57.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.943+0000 7f62837fe700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 0x7f627c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:57.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.943+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f629c0a5130 con 0x7f62a414b770 2020-11-20T11:45:57.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.943+0000 7f62a37fe700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 0x7f627c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:57.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.944+0000 7f62a37fe700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 0x7f627c082af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f62980035f0 tx=0x7f6298007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:57.956 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:57.947+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f629c079b40 con 0x7f62a414b770 2020-11-20T11:45:58.185 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.182+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a4061910 con 0x7f627c080630 2020-11-20T11:45:58.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.182+0000 7f62837fe700 1 -- 172.21.15.105:0/1206124834 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62a4061910 con 0x7f627c080630 2020-11-20T11:45:58.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 msgr2=0x7f627c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 0x7f627c082af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f62980035f0 tx=0x7f6298007b90).stop 2020-11-20T11:45:58.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 msgr2=0x7f62a4144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f629c009e70 tx=0x7f629c016000).stop 2020-11-20T11:45:58.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 shutdown_connections 2020-11-20T11:45:58.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f627c080630 0x7f627c082af0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a414b770 0x7f62a4144060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a40bdda0 0x7f62a41531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 --2- 172.21.15.105:0/1206124834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a414b390 0x7f62a40bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 >> 172.21.15.105:0/1206124834 conn(0x7f62a40b9910 msgr2=0x7f62a4065160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:58.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 shutdown_connections 2020-11-20T11:45:58.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.185+0000 7f62a9dee700 1 -- 172.21.15.105:0/1206124834 wait complete. 2020-11-20T11:45:58.298 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T11:45:58.298 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T11:45:58.298 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:45:58.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.474+0000 7fd1a33ec700 1 Processor -- start 2020-11-20T11:45:58.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.474+0000 7fd1a33ec700 1 -- start start 2020-11-20T11:45:58.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a33ec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd19c0622c0 0x7fd19c0667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a33ec700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c065030 con 0x7fd19c150cd0 2020-11-20T11:45:58.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a33ec700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0be670 con 0x7fd19c061ee0 2020-11-20T11:45:58.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a33ec700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0be910 con 0x7fd19c0622c0 2020-11-20T11:45:58.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a1188700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd19c061ee0 0x7fd19c0659a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41938/0 (socket says 172.21.15.105:41938) 2020-11-20T11:45:58.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a1188700 1 -- 172.21.15.105:0/3069233904 learned_addr learned my addr 172.21.15.105:0/3069233904 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:58.481 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd1a1989700 1 --2- 172.21.15.105:0/3069233904 >> v2:172.21.15.67:3300/0 conn(0x7fd19c0622c0 0x7fd19c0667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.482 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576207617 0 0) 0x7fd19c0be670 con 0x7fd19c061ee0 2020-11-20T11:45:58.482 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.475+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd184003240 con 0x7fd19c061ee0 2020-11-20T11:45:58.483 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853980006 0 0) 0x7fd19c065030 con 0x7fd19c150cd0 2020-11-20T11:45:58.484 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd19c0be670 con 0x7fd19c150cd0 2020-11-20T11:45:58.485 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd1a1989700 1 -- 172.21.15.105:0/3069233904 >> v1:172.21.15.105:6789/0 conn(0x7fd19c061ee0 legacy=0x7fd19c0659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd1a1989700 1 -- 172.21.15.105:0/3069233904 >> v1:172.21.15.100:6789/0 conn(0x7fd19c150cd0 legacy=0x7fd19c0bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.486 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd1a1989700 1 -- 172.21.15.105:0/3069233904 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0bebb0 con 0x7fd19c0622c0 2020-11-20T11:45:58.487 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd1a1989700 1 --2- 172.21.15.105:0/3069233904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c0622c0 0x7fd19c0667b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd194009c10 tx=0x7fd1940091d0).ready entity=mon.0 client_cookie=e079309c66eb997b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.490 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980014e0 con 0x7fd19c0622c0 2020-11-20T11:45:58.490 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400b730 con 0x7fd19c0622c0 2020-11-20T11:45:58.491 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.476+0000 7fd18bfff700 1 -- 172.21.15.105:0/3069233904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400bab0 con 0x7fd19c0622c0 2020-11-20T11:45:58.491 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.477+0000 7fd1a33ec700 1 -- 172.21.15.105:0/3069233904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c0622c0 msgr2=0x7fd19c0667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.492 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.477+0000 7fd1a33ec700 1 --2- 172.21.15.105:0/3069233904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c0622c0 0x7fd19c0667b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd194009c10 tx=0x7fd1940091d0).stop 2020-11-20T11:45:58.493 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.486+0000 7fd1a33ec700 1 -- 172.21.15.105:0/3069233904 shutdown_connections 2020-11-20T11:45:58.493 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.486+0000 7fd1a33ec700 1 --2- 172.21.15.105:0/3069233904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c0622c0 0x7fd19c0667b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.494 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.486+0000 7fd1a33ec700 1 -- 172.21.15.105:0/3069233904 >> 172.21.15.105:0/3069233904 conn(0x7fd19c060130 msgr2=0x7fd19c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:58.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.491+0000 7fd1a33ec700 1 -- 172.21.15.105:0/3069233904 shutdown_connections 2020-11-20T11:45:58.496 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.492+0000 7fd1a33ec700 1 -- 172.21.15.105:0/3069233904 wait complete. 2020-11-20T11:45:58.498 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.494+0000 7fd1a33ec700 1 Processor -- start 2020-11-20T11:45:58.499 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.494+0000 7fd1a33ec700 1 -- start start 2020-11-20T11:45:58.505 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 0x7fd19c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd19c0622c0 0x7fd19c0bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd19c150cd0 0x7fd19c0bab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0c2a20 con 0x7fd19c061ee0 2020-11-20T11:45:58.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0c1860 con 0x7fd19c150cd0 2020-11-20T11:45:58.506 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a33ec700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0c1b00 con 0x7fd19c0622c0 2020-11-20T11:45:58.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a1188700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 0x7fd19c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.495+0000 7fd1a1188700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 0x7fd19c15d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45636/0 (socket says 172.21.15.105:45636) 2020-11-20T11:45:58.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.496+0000 7fd1a1989700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd19c150cd0 0x7fd19c0bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.496+0000 7fd1a1188700 1 -- 172.21.15.105:0/741666070 learned_addr learned my addr 172.21.15.105:0/741666070 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:58.507 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.496+0000 7fd1a1188700 1 -- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd19c0622c0 msgr2=0x7fd19c0bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.508 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.496+0000 7fd1a0987700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd19c0622c0 0x7fd19c0bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.508 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1188700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd19c0622c0 0x7fd19c0bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.508 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1188700 1 -- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd19c150cd0 msgr2=0x7fd19c0bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.508 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1188700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd19c150cd0 0x7fd19c0bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1188700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0c1da0 con 0x7fd19c061ee0 2020-11-20T11:45:58.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1989700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd19c150cd0 0x7fd19c0bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:58.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a0987700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd19c0622c0 0x7fd19c0bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:45:58.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1a1188700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 0x7fd19c15d2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd19800cc00 tx=0x7fd198001ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.509 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198007170 con 0x7fd19c061ee0 2020-11-20T11:45:58.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.497+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980072d0 con 0x7fd19c061ee0 2020-11-20T11:45:58.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.498+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800aaf0 con 0x7fd19c061ee0 2020-11-20T11:45:58.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.498+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c0c2040 con 0x7fd19c061ee0 2020-11-20T11:45:58.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.498+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c0c2580 con 0x7fd19c061ee0 2020-11-20T11:45:58.510 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.499+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd19c069680 con 0x7fd19c061ee0 2020-11-20T11:45:58.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.500+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd198010070 con 0x7fd19c061ee0 2020-11-20T11:45:58.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.500+0000 7fd1897fa700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd178080660 0x7fd178082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.500+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd1980a2660 con 0x7fd19c061ee0 2020-11-20T11:45:58.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.500+0000 7fd1897fa700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fd178089390 0x7fd17808b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.511 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.500+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd17808be10 con 0x7fd178089390 2020-11-20T11:45:58.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.501+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1980a4c40 con 0x7fd19c061ee0 2020-11-20T11:45:58.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.501+0000 7fd1a1989700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fd178089390 0x7fd17808b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.512 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.501+0000 7fd1a1989700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fd178089390 0x7fd17808b7b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.502+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== osd.3 v2:172.21.15.105:6808/24841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd17808be10 con 0x7fd178089390 2020-11-20T11:45:58.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.506+0000 7fd1a0987700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd178080660 0x7fd178082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.513 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.507+0000 7fd1a0987700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd178080660 0x7fd178082b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd19c0bdc90 tx=0x7fd18c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.535 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.526+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 --> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd19c044f60 con 0x7fd178089390 2020-11-20T11:45:58.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.526+0000 7fd1897fa700 1 -- 172.21.15.105:0/741666070 <== osd.3 v2:172.21.15.105:6808/24841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd19c044f60 con 0x7fd178089390 2020-11-20T11:45:58.536 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fd178089390 msgr2=0x7fd17808b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.105:6808/24841,v1:172.21.15.105:6809/24841] conn(0x7fd178089390 0x7fd17808b7b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd178080660 msgr2=0x7fd178082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fd178080660 0x7fd178082b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd19c0bdc90 tx=0x7fd18c009040).stop 2020-11-20T11:45:58.537 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 msgr2=0x7fd19c15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 --2- 172.21.15.105:0/741666070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c061ee0 0x7fd19c15d2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd19800cc00 tx=0x7fd198001ce0).stop 2020-11-20T11:45:58.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a1989700 1 -- 172.21.15.105:0/741666070 reap_dead start 2020-11-20T11:45:58.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 shutdown_connections 2020-11-20T11:45:58.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.527+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 >> 172.21.15.105:0/741666070 conn(0x7fd19c060130 msgr2=0x7fd19c067640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:58.538 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.529+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 shutdown_connections 2020-11-20T11:45:58.539 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.529+0000 7fd1a33ec700 1 -- 172.21.15.105:0/741666070 wait complete. 2020-11-20T11:45:58.539 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:45:58.539 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:45:58.539 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:45:58.544 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T11:45:58.702 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.699+0000 7f43bb079700 1 Processor -- start 2020-11-20T11:45:58.703 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.699+0000 7f43bb079700 1 -- start start 2020-11-20T11:45:58.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43bb079700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43b4061d20 0x7f43b4067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43bb079700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4062260 con 0x7f43b40c25b0 2020-11-20T11:45:58.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43bb079700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4062500 con 0x7f43b4067380 2020-11-20T11:45:58.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43bb079700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b40627a0 con 0x7f43b4061d20 2020-11-20T11:45:58.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b8e15700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f43b4067380 0x7f43b4151b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:41954/0 (socket says 172.21.15.105:41954) 2020-11-20T11:45:58.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b8e15700 1 -- 172.21.15.105:0/224326314 learned_addr learned my addr 172.21.15.105:0/224326314 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:58.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b9616700 1 --2- 172.21.15.105:0/224326314 >> v2:172.21.15.100:3300/0 conn(0x7f43b4061d20 0x7f43b4067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b37fe700 1 -- 172.21.15.105:0/224326314 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485320432 0 0) 0x7f43b4062500 con 0x7f43b4067380 2020-11-20T11:45:58.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b37fe700 1 -- 172.21.15.105:0/224326314 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4398003240 con 0x7f43b4067380 2020-11-20T11:45:58.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b9616700 1 -- 172.21.15.105:0/224326314 >> v1:172.21.15.105:6789/0 conn(0x7f43b4067380 legacy=0x7f43b4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b9616700 1 -- 172.21.15.105:0/224326314 >> v1:172.21.15.67:6789/0 conn(0x7f43b40c25b0 legacy=0x7f43b40667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.707 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b9616700 1 -- 172.21.15.105:0/224326314 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b41513e0 con 0x7f43b4061d20 2020-11-20T11:45:58.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b9616700 1 --2- 172.21.15.105:0/224326314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b4067760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f43ac009c90 tx=0x7f43ac0091d0).ready entity=mon.1 client_cookie=f8d6d480dcdb41ac server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b37fe700 1 -- 172.21.15.105:0/224326314 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00ba70 con 0x7f43b4061d20 2020-11-20T11:45:58.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b37fe700 1 -- 172.21.15.105:0/224326314 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00bbd0 con 0x7f43b4061d20 2020-11-20T11:45:58.708 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.700+0000 7f43b37fe700 1 -- 172.21.15.105:0/224326314 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011400 con 0x7f43b4061d20 2020-11-20T11:45:58.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 -- 172.21.15.105:0/224326314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 msgr2=0x7f43b4067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 --2- 172.21.15.105:0/224326314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b4067760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f43ac009c90 tx=0x7f43ac0091d0).stop 2020-11-20T11:45:58.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 -- 172.21.15.105:0/224326314 shutdown_connections 2020-11-20T11:45:58.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 --2- 172.21.15.105:0/224326314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b4067760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.709 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 -- 172.21.15.105:0/224326314 >> 172.21.15.105:0/224326314 conn(0x7f43b40bdd20 msgr2=0x7f43b40be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:58.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 -- 172.21.15.105:0/224326314 shutdown_connections 2020-11-20T11:45:58.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.701+0000 7f43bb079700 1 -- 172.21.15.105:0/224326314 wait complete. 2020-11-20T11:45:58.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.703+0000 7f43bb079700 1 Processor -- start 2020-11-20T11:45:58.711 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 -- start start 2020-11-20T11:45:58.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b4067380 0x7f43b4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43b40c25b0 0x7f43b4165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41559f0 con 0x7f43b40c25b0 2020-11-20T11:45:58.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4154970 con 0x7f43b4061d20 2020-11-20T11:45:58.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.707+0000 7f43bb079700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4084210 con 0x7f43b4067380 2020-11-20T11:45:58.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b4067380 0x7f43b4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60482/0 (socket says 172.21.15.105:60482) 2020-11-20T11:45:58.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 -- 172.21.15.105:0/3124880024 learned_addr learned my addr 172.21.15.105:0/3124880024 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:58.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 -- 172.21.15.105:0/3124880024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b4067380 msgr2=0x7f43b4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b4067380 0x7f43b4155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 -- 172.21.15.105:0/3124880024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43b40c25b0 msgr2=0x7f43b4165010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:45:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43b40c25b0 0x7f43b4165010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:45:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 -- 172.21.15.105:0/3124880024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4153c50 con 0x7f43b4061d20 2020-11-20T11:45:58.716 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b8e15700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f43a800c720 tx=0x7f43a8007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007320 con 0x7f43b4061d20 2020-11-20T11:45:58.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8007480 con 0x7f43b4061d20 2020-11-20T11:45:58.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8005800 con 0x7f43b4061d20 2020-11-20T11:45:58.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b4153ef0 con 0x7f43b4061d20 2020-11-20T11:45:58.717 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.708+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b4154430 con 0x7f43b4061d20 2020-11-20T11:45:58.718 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.709+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b4167e60 con 0x7f43b4061d20 2020-11-20T11:45:58.719 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.710+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f43a8010030 con 0x7f43b4061d20 2020-11-20T11:45:58.719 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.711+0000 7f43b0ff9700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 0x7f438c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:58.719 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.711+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f43a80a27c0 con 0x7f43b4061d20 2020-11-20T11:45:58.719 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.711+0000 7f43b3fff700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 0x7f438c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:58.719 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.711+0000 7f43b3fff700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 0x7f438c082b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f43b415cc00 tx=0x7f43a0007b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:58.720 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.715+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f43b4167e60 con 0x7f43b4061d20 2020-11-20T11:45:58.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.936+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f43b4044f60 con 0x7f438c080660 2020-11-20T11:45:58.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.936+0000 7f43b0ff9700 1 -- 172.21.15.105:0/3124880024 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43b4044f60 con 0x7f438c080660 2020-11-20T11:45:58.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 msgr2=0x7f438c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 0x7f438c082b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f43b415cc00 tx=0x7f43a0007b70).stop 2020-11-20T11:45:58.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 msgr2=0x7f43b40c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:58.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f43a800c720 tx=0x7f43a8007ad0).stop 2020-11-20T11:45:58.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 shutdown_connections 2020-11-20T11:45:58.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43b40c25b0 0x7f43b4165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:45:58.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b4061d20 0x7f43b40c8170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f438c080660 0x7f438c082b20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 --2- 172.21.15.105:0/3124880024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b4067380 0x7f43b4155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:58.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 >> 172.21.15.105:0/3124880024 conn(0x7f43b40bdd20 msgr2=0x7f43b40bfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:58.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 shutdown_connections 2020-11-20T11:45:58.945 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:58.938+0000 7f43bb079700 1 -- 172.21.15.105:0/3124880024 wait complete. 2020-11-20T11:45:58.949 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T11:45:58.955 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T11:45:58.956 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:45:59.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.117+0000 7f221b83c700 1 Processor -- start 2020-11-20T11:45:59.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.117+0000 7f221b83c700 1 -- start start 2020-11-20T11:45:59.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f221b83c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22140bc8c0 0x7f22140bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f221b83c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 0x7f22140bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f221b83c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2214062f70 con 0x7f2214063e20 2020-11-20T11:45:59.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f221b83c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140be210 con 0x7f22140bd360 2020-11-20T11:45:59.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f221b83c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140631a0 con 0x7f22140bc8c0 2020-11-20T11:45:59.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f2219dd9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 0x7f22140bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22140bc8c0 0x7f22140bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f2219dd9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 0x7f22140bd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45660/0 (socket says 172.21.15.105:45660) 2020-11-20T11:45:59.125 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22140bc8c0 0x7f22140bcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60488/0 (socket says 172.21.15.105:60488) 2020-11-20T11:45:59.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f2219dd9700 1 -- 172.21.15.105:0/2712861647 learned_addr learned my addr 172.21.15.105:0/2712861647 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:59.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f2218dd7700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2214063e20 0x7f22140667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:60980/0 (socket says 172.21.15.105:60980) 2020-11-20T11:45:59.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 -- 172.21.15.105:0/2712861647 >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 msgr2=0x7f22140bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:45:59.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 --2- 172.21.15.105:0/2712861647 >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 0x7f22140bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 -- 172.21.15.105:0/2712861647 >> v1:172.21.15.100:6789/0 conn(0x7f2214063e20 legacy=0x7f22140667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f22195d8700 1 -- 172.21.15.105:0/2712861647 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214063440 con 0x7f22140bc8c0 2020-11-20T11:45:59.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.118+0000 7f2203fff700 1 -- 172.21.15.105:0/2712861647 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727709824 0 0) 0x7f2214062f70 con 0x7f2214063e20 2020-11-20T11:45:59.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f22195d8700 1 --2- 172.21.15.105:0/2712861647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f22140bcca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f221405d330 tx=0x7f2210006e80).ready entity=mon.1 client_cookie=6af02890ce2f6134 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f2203fff700 1 -- 172.21.15.105:0/2712861647 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000bb70 con 0x7f22140bc8c0 2020-11-20T11:45:59.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f2203fff700 1 -- 172.21.15.105:0/2712861647 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000bcd0 con 0x7f22140bc8c0 2020-11-20T11:45:59.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f2203fff700 1 -- 172.21.15.105:0/2712861647 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210010680 con 0x7f22140bc8c0 2020-11-20T11:45:59.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 -- 172.21.15.105:0/2712861647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 msgr2=0x7f22140bcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.129 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 --2- 172.21.15.105:0/2712861647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f22140bcca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f221405d330 tx=0x7f2210006e80).stop 2020-11-20T11:45:59.129 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 -- 172.21.15.105:0/2712861647 shutdown_connections 2020-11-20T11:45:59.129 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 --2- 172.21.15.105:0/2712861647 >> v2:172.21.15.67:3300/0 conn(0x7f22140bd360 0x7f22140bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.129 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 --2- 172.21.15.105:0/2712861647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f22140bcca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 -- 172.21.15.105:0/2712861647 >> 172.21.15.105:0/2712861647 conn(0x7f22140c4520 msgr2=0x7f22140c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 -- 172.21.15.105:0/2712861647 shutdown_connections 2020-11-20T11:45:59.130 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.119+0000 7f221b83c700 1 -- 172.21.15.105:0/2712861647 wait complete. 2020-11-20T11:45:59.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.120+0000 7f221b83c700 1 Processor -- start 2020-11-20T11:45:59.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.120+0000 7f221b83c700 1 -- start start 2020-11-20T11:45:59.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 0x7f22140c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f221414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22140bd360 0x7f221414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214163be0 con 0x7f22140bd360 2020-11-20T11:45:59.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22141510d0 con 0x7f22140bc8c0 2020-11-20T11:45:59.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f221b83c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214160660 con 0x7f2214063e20 2020-11-20T11:45:59.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f22195d8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 0x7f22140c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f22195d8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 0x7f22140c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42366/0 (socket says 172.21.15.105:42366) 2020-11-20T11:45:59.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f22195d8700 1 -- 172.21.15.105:0/1160339008 learned_addr learned my addr 172.21.15.105:0/1160339008 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:59.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f2218dd7700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f221414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.121+0000 7f2219dd9700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22140bd360 0x7f221414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 -- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 msgr2=0x7f22140c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 0x7f22140c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 -- 172.21.15.105:0/1160339008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22140bd360 msgr2=0x7f221414a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22140bd360 0x7f221414a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140c0d40 con 0x7f22140bc8c0 2020-11-20T11:45:59.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f22195d8700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2214063e20 0x7f22140c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:45:59.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f2218dd7700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f221414cc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f220400c760 tx=0x7f2204007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040072e0 con 0x7f22140bc8c0 2020-11-20T11:45:59.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204005530 con 0x7f22140bc8c0 2020-11-20T11:45:59.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2214151330 con 0x7f22140bc8c0 2020-11-20T11:45:59.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040058d0 con 0x7f22140bc8c0 2020-11-20T11:45:59.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.122+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2214151870 con 0x7f22140bc8c0 2020-11-20T11:45:59.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.123+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2214068d00 con 0x7f22140bc8c0 2020-11-20T11:45:59.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.124+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2204010070 con 0x7f22140bc8c0 2020-11-20T11:45:59.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.124+0000 7f22017fa700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f21ec080630 0x7f21ec082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f22040a2310 con 0x7f22140bc8c0 2020-11-20T11:45:59.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22195d8700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f21ec080630 0x7f21ec082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22017fa700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f21ec089360 0x7f21ec08b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21ec08bde0 con 0x7f21ec089360 2020-11-20T11:45:59.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22040a2680 con 0x7f22140bc8c0 2020-11-20T11:45:59.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f2219dd9700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f21ec089360 0x7f21ec08b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f22195d8700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f21ec080630 0x7f21ec082af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2210002fc0 tx=0x7f2214062bf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.125+0000 7f2219dd9700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f21ec089360 0x7f21ec08b780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.141 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.126+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== osd.6 v2:172.21.15.105:6813/24842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f21ec08bde0 con 0x7f21ec089360 2020-11-20T11:45:59.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.143+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 --> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2214163d50 con 0x7f21ec089360 2020-11-20T11:45:59.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f22017fa700 1 -- 172.21.15.105:0/1160339008 <== osd.6 v2:172.21.15.105:6813/24842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2214163d50 con 0x7f21ec089360 2020-11-20T11:45:59.148 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:45:59.150 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:45:59.150 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:45:59.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f21ec089360 msgr2=0x7f21ec08b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.105:6813/24842,v1:172.21.15.105:6815/24842] conn(0x7f21ec089360 0x7f21ec08b780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f21ec080630 msgr2=0x7f21ec082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f21ec080630 0x7f21ec082af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2210002fc0 tx=0x7f2214062bf0).stop 2020-11-20T11:45:59.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 msgr2=0x7f221414cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 --2- 172.21.15.105:0/1160339008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22140bc8c0 0x7f221414cc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f220400c760 tx=0x7f2204007a20).stop 2020-11-20T11:45:59.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f2219dd9700 1 -- 172.21.15.105:0/1160339008 reap_dead start 2020-11-20T11:45:59.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 shutdown_connections 2020-11-20T11:45:59.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 >> 172.21.15.105:0/1160339008 conn(0x7f22140c4520 msgr2=0x7f22140c28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 shutdown_connections 2020-11-20T11:45:59.154 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.144+0000 7f221b83c700 1 -- 172.21.15.105:0/1160339008 wait complete. 2020-11-20T11:45:59.159 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T11:45:59.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.320+0000 7f68532f9700 1 Processor -- start 2020-11-20T11:45:59.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.320+0000 7f68532f9700 1 -- start start 2020-11-20T11:45:59.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.320+0000 7f68532f9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f684c0bfd60 0x7f684c0c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f68532f9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f684c14dbc0 0x7f684c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.327 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f68532f9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c061d20 con 0x7f684c1518e0 2020-11-20T11:45:59.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f68532f9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0be1c0 con 0x7f684c0bfd60 2020-11-20T11:45:59.328 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f68532f9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0be460 con 0x7f684c14dbc0 2020-11-20T11:45:59.329 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f684c14dbc0 0x7f684c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f684c14dbc0 0x7f684c14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42380/0 (socket says 172.21.15.105:42380) 2020-11-20T11:45:59.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 -- 172.21.15.105:0/2845593209 learned_addr learned my addr 172.21.15.105:0/2845593209 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:59.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851095700 1 --2- 172.21.15.105:0/2845593209 >> v2:172.21.15.67:3300/0 conn(0x7f684c0bfd60 0x7f684c0c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f683bfff700 1 -- 172.21.15.105:0/2845593209 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535077 0 0) 0x7f684c061d20 con 0x7f684c1518e0 2020-11-20T11:45:59.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 -- 172.21.15.105:0/2845593209 >> v2:172.21.15.67:3300/0 conn(0x7f684c0bfd60 msgr2=0x7f684c0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:45:59.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 --2- 172.21.15.105:0/2845593209 >> v2:172.21.15.67:3300/0 conn(0x7f684c0bfd60 0x7f684c0c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 -- 172.21.15.105:0/2845593209 >> v1:172.21.15.67:6789/0 conn(0x7f684c1518e0 legacy=0x7f684c067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.331 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 -- 172.21.15.105:0/2845593209 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c14d790 con 0x7f684c14dbc0 2020-11-20T11:45:59.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f6851896700 1 --2- 172.21.15.105:0/2845593209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c14dbc0 0x7f684c14e010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f684c066170 tx=0x7f6844009290).ready entity=mon.2 client_cookie=2a87be9741c50b92 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f683bfff700 1 -- 172.21.15.105:0/2845593209 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400bbc0 con 0x7f684c14dbc0 2020-11-20T11:45:59.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f683bfff700 1 -- 172.21.15.105:0/2845593209 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400bd20 con 0x7f684c14dbc0 2020-11-20T11:45:59.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.321+0000 7f683bfff700 1 -- 172.21.15.105:0/2845593209 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844011610 con 0x7f684c14dbc0 2020-11-20T11:45:59.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 -- 172.21.15.105:0/2845593209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c14dbc0 msgr2=0x7f684c14e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 --2- 172.21.15.105:0/2845593209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c14dbc0 0x7f684c14e010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f684c066170 tx=0x7f6844009290).stop 2020-11-20T11:45:59.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 -- 172.21.15.105:0/2845593209 shutdown_connections 2020-11-20T11:45:59.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 --2- 172.21.15.105:0/2845593209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c14dbc0 0x7f684c14e010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 --2- 172.21.15.105:0/2845593209 >> v2:172.21.15.67:3300/0 conn(0x7f684c0bfd60 0x7f684c0c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 -- 172.21.15.105:0/2845593209 >> 172.21.15.105:0/2845593209 conn(0x7f684c0b9910 msgr2=0x7f684c0b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 -- 172.21.15.105:0/2845593209 shutdown_connections 2020-11-20T11:45:59.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.322+0000 7f68532f9700 1 -- 172.21.15.105:0/2845593209 wait complete. 2020-11-20T11:45:59.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 Processor -- start 2020-11-20T11:45:59.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 -- start start 2020-11-20T11:45:59.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f684c0bfd60 0x7f684c097270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.338 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f684c14dbc0 0x7f684c1687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.338 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.338 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c168cc0 con 0x7f684c0bfd60 2020-11-20T11:45:59.338 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0bc4a0 con 0x7f684c14dbc0 2020-11-20T11:45:59.338 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f68532f9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0bc740 con 0x7f684c1518e0 2020-11-20T11:45:59.339 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.324+0000 7f6851896700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.339 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851095700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f684c0bfd60 0x7f684c097270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.339 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42386/0 (socket says 172.21.15.105:42386) 2020-11-20T11:45:59.339 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 -- 172.21.15.105:0/1205073433 learned_addr learned my addr 172.21.15.105:0/1205073433 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:59.339 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6850894700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f684c14dbc0 0x7f684c1687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 -- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f684c14dbc0 msgr2=0x7f684c1687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f684c14dbc0 0x7f684c1687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 -- 172.21.15.105:0/1205073433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f684c0bfd60 msgr2=0x7f684c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f684c0bfd60 0x7f684c097270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 -- 172.21.15.105:0/1205073433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0bc9e0 con 0x7f684c1518e0 2020-11-20T11:45:59.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f6851896700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f68440092d0 tx=0x7f6844016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844020070 con 0x7f684c1518e0 2020-11-20T11:45:59.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400be90 con 0x7f684c1518e0 2020-11-20T11:45:59.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400bbc0 con 0x7f684c1518e0 2020-11-20T11:45:59.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c098dc0 con 0x7f684c1518e0 2020-11-20T11:45:59.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.325+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c099500 con 0x7f684c1518e0 2020-11-20T11:45:59.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.326+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c099220 con 0x7f684c1518e0 2020-11-20T11:45:59.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.327+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6844017070 con 0x7f684c1518e0 2020-11-20T11:45:59.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.327+0000 7f68397fa700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 0x7f6824082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.328+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f68440a47a0 con 0x7f684c1518e0 2020-11-20T11:45:59.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.328+0000 7f6851095700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 0x7f6824082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.328+0000 7f6851095700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 0x7f6824082b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6848006fd0 tx=0x7f6848006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.332+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f68440791b0 con 0x7f684c1518e0 2020-11-20T11:45:59.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.546+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f684c044f60 con 0x7f6824080660 2020-11-20T11:45:59.550 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.546+0000 7f68397fa700 1 -- 172.21.15.105:0/1205073433 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f684c044f60 con 0x7f6824080660 2020-11-20T11:45:59.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 msgr2=0x7f6824082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 0x7f6824082b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6848006fd0 tx=0x7f6848006df0).stop 2020-11-20T11:45:59.553 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 msgr2=0x7f684c14bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f68440092d0 tx=0x7f6844016000).stop 2020-11-20T11:45:59.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 shutdown_connections 2020-11-20T11:45:59.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6824080660 0x7f6824082b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.554 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c1518e0 0x7f684c14bae0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f684c0bfd60 0x7f684c097270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 --2- 172.21.15.105:0/1205073433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f684c14dbc0 0x7f684c1687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.555 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 >> 172.21.15.105:0/1205073433 conn(0x7f684c0b9910 msgr2=0x7f684c145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.556 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 shutdown_connections 2020-11-20T11:45:59.556 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.548+0000 7f68532f9700 1 -- 172.21.15.105:0/1205073433 wait complete. 2020-11-20T11:45:59.557 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T11:45:59.563 INFO:tasks.ceph:Scrubbing osd.9 2020-11-20T11:45:59.564 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:45:59.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.700+0000 7f8bebfe4700 1 Processor -- start 2020-11-20T11:45:59.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.700+0000 7f8bebfe4700 1 -- start start 2020-11-20T11:45:59.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.701+0000 7f8bebfe4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8be4060cd0 0x7f8be415e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.701+0000 7f8bebfe4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be415e910 con 0x7f8be4065f30 2020-11-20T11:45:59.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.701+0000 7f8bebfe4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be40bf740 con 0x7f8be40651f0 2020-11-20T11:45:59.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.701+0000 7f8bebfe4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40c07f0 con 0x7f8be4060cd0 2020-11-20T11:45:59.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.702+0000 7f8be9d80700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8be40651f0 0x7f8be40c00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:32778/0 (socket says 172.21.15.105:32778) 2020-11-20T11:45:59.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.702+0000 7f8bea581700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8be4060cd0 0x7f8be415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.702+0000 7f8be9d80700 1 -- 172.21.15.105:0/2463146161 learned_addr learned my addr 172.21.15.105:0/2463146161 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:45:59.810 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.702+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700568433 0 0) 0x7f8be40bf740 con 0x7f8be40651f0 2020-11-20T11:45:59.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd0003160 con 0x7f8be40651f0 2020-11-20T11:45:59.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187521655 0 0) 0x7f8be415e910 con 0x7f8be4065f30 2020-11-20T11:45:59.811 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be40bf740 con 0x7f8be4065f30 2020-11-20T11:45:59.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8bea581700 1 -- 172.21.15.105:0/2463146161 >> v1:172.21.15.100:6789/0 conn(0x7f8be40651f0 legacy=0x7f8be40c00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8bea581700 1 -- 172.21.15.105:0/2463146161 >> v1:172.21.15.67:6789/0 conn(0x7f8be4065f30 legacy=0x7f8be415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8bea581700 1 -- 172.21.15.105:0/2463146161 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be40be0f0 con 0x7f8be4060cd0 2020-11-20T11:45:59.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.806+0000 7f8bea581700 1 --2- 172.21.15.105:0/2463146161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be4060cd0 0x7f8be415e370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8bd400b9a0 tx=0x7f8bd4006df0).ready entity=mon.0 client_cookie=b385917c3e1188d3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.812 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.807+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4009680 con 0x7f8be4060cd0 2020-11-20T11:45:59.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.807+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40097e0 con 0x7f8be4060cd0 2020-11-20T11:45:59.813 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.807+0000 7f8be8d7e700 1 -- 172.21.15.105:0/2463146161 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4009b60 con 0x7f8be4060cd0 2020-11-20T11:45:59.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 -- 172.21.15.105:0/2463146161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be4060cd0 msgr2=0x7f8be415e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 --2- 172.21.15.105:0/2463146161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be4060cd0 0x7f8be415e370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8bd400b9a0 tx=0x7f8bd4006df0).stop 2020-11-20T11:45:59.814 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 -- 172.21.15.105:0/2463146161 shutdown_connections 2020-11-20T11:45:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 --2- 172.21.15.105:0/2463146161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be4060cd0 0x7f8be415e370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 -- 172.21.15.105:0/2463146161 >> 172.21.15.105:0/2463146161 conn(0x7f8be4060130 msgr2=0x7f8be4060510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 -- 172.21.15.105:0/2463146161 shutdown_connections 2020-11-20T11:45:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.809+0000 7f8bebfe4700 1 -- 172.21.15.105:0/2463146161 wait complete. 2020-11-20T11:45:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.810+0000 7f8bebfe4700 1 Processor -- start 2020-11-20T11:45:59.816 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.810+0000 7f8bebfe4700 1 -- start start 2020-11-20T11:45:59.817 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 0x7f8be416d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be40651f0 0x7f8be408ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be4065f30 0x7f8be40c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be416dee0 con 0x7f8be40651f0 2020-11-20T11:45:59.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be408f550 con 0x7f8be4065f30 2020-11-20T11:45:59.818 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8bebfe4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41705a0 con 0x7f8be4060cd0 2020-11-20T11:45:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8be9d80700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 0x7f8be416d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8be9d80700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 0x7f8be416d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42396/0 (socket says 172.21.15.105:42396) 2020-11-20T11:45:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.811+0000 7f8be9d80700 1 -- 172.21.15.105:0/170980228 learned_addr learned my addr 172.21.15.105:0/170980228 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:45:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8bea581700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be4065f30 0x7f8be40c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 -- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be4065f30 msgr2=0x7f8be40c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be4065f30 0x7f8be40c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 -- 172.21.15.105:0/170980228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be40651f0 msgr2=0x7f8be408ed00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:45:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be40651f0 0x7f8be408ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:45:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4170840 con 0x7f8be4060cd0 2020-11-20T11:45:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8be9d80700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 0x7f8be416d9f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8be000c740 tx=0x7f8be0007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be00072e0 con 0x7f8be4060cd0 2020-11-20T11:45:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0007440 con 0x7f8be4060cd0 2020-11-20T11:45:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.812+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be00057e0 con 0x7f8be4060cd0 2020-11-20T11:45:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.813+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be4170ae0 con 0x7f8be4060cd0 2020-11-20T11:45:59.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.813+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be4171020 con 0x7f8be4060cd0 2020-11-20T11:45:59.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.814+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8be4044f60 con 0x7f8be4060cd0 2020-11-20T11:45:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.815+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8be0010070 con 0x7f8be4060cd0 2020-11-20T11:45:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.816+0000 7f8bd9ffb700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8bc4080630 0x7f8bc4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.816+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8be00a2b10 con 0x7f8be4060cd0 2020-11-20T11:45:59.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.816+0000 7f8bd9ffb700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f8bc4089360 0x7f8bc408b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:45:59.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.816+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bc408bde0 con 0x7f8bc4089360 2020-11-20T11:45:59.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.816+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be00a2e40 con 0x7f8be4060cd0 2020-11-20T11:45:59.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.817+0000 7f8bea581700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f8bc4089360 0x7f8bc408b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.824 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.817+0000 7f8bea581700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f8bc4089360 0x7f8bc408b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.818+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== osd.9 v2:172.21.15.105:6824/24843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f8bc408bde0 con 0x7f8bc4089360 2020-11-20T11:45:59.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.820+0000 7f8be957f700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8bc4080630 0x7f8bc4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:45:59.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.821+0000 7f8be957f700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8bc4080630 0x7f8bc4082af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8bdc007fd0 tx=0x7f8bdc007950).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:45:59.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.846+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 --> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8be405cc80 con 0x7f8bc4089360 2020-11-20T11:45:59.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.847+0000 7f8bd9ffb700 1 -- 172.21.15.105:0/170980228 <== osd.9 v2:172.21.15.105:6824/24843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8be405cc80 con 0x7f8bc4089360 2020-11-20T11:45:59.852 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:45:59.852 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:45:59.852 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:45:59.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.849+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f8bc4089360 msgr2=0x7f8bc408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.849+0000 7f8bebfe4700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:6824/24843,v1:172.21.15.105:6825/24843] conn(0x7f8bc4089360 0x7f8bc408b780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:45:59.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8bc4080630 msgr2=0x7f8bc4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8bc4080630 0x7f8bc4082af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8bdc007fd0 tx=0x7f8bdc007950).stop 2020-11-20T11:45:59.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 msgr2=0x7f8be416d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:45:59.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 --2- 172.21.15.105:0/170980228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8be4060cd0 0x7f8be416d9f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8be000c740 tx=0x7f8be0007ad0).stop 2020-11-20T11:45:59.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bea581700 1 -- 172.21.15.105:0/170980228 reap_dead start 2020-11-20T11:45:59.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 shutdown_connections 2020-11-20T11:45:59.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 >> 172.21.15.105:0/170980228 conn(0x7f8be4060130 msgr2=0x7f8be415c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:45:59.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 shutdown_connections 2020-11-20T11:45:59.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:45:59.850+0000 7f8bebfe4700 1 -- 172.21.15.105:0/170980228 wait complete. 2020-11-20T11:45:59.866 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2020-11-20T11:46:00.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.027+0000 7f6f3af7a700 1 Processor -- start 2020-11-20T11:46:00.031 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.027+0000 7f6f3af7a700 1 -- start start 2020-11-20T11:46:00.033 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f3414b390 0x7f6f3414df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.034 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f3414b770 0x7f6f340c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.034 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f340c0aa0 0x7f6f34062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.034 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3414eec0 con 0x7f6f340c0aa0 2020-11-20T11:46:00.034 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340bfc10 con 0x7f6f3414b390 2020-11-20T11:46:00.035 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f3af7a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3414e6e0 con 0x7f6f3414b770 2020-11-20T11:46:00.035 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f3414b770 0x7f6f340c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.035 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f3414b770 0x7f6f340c05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42408/0 (socket says 172.21.15.105:42408) 2020-11-20T11:46:00.035 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 -- 172.21.15.105:0/296110125 learned_addr learned my addr 172.21.15.105:0/296110125 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:00.035 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f39517700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.67:3300/0 conn(0x7f6f340c0aa0 0x7f6f34062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.036 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f38d16700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.100:3300/0 conn(0x7f6f3414b390 0x7f6f3414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.036 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 -- 172.21.15.105:0/296110125 >> v2:172.21.15.100:3300/0 conn(0x7f6f3414b390 msgr2=0x7f6f3414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:00.036 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.100:3300/0 conn(0x7f6f3414b390 0x7f6f3414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.036 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 -- 172.21.15.105:0/296110125 >> v2:172.21.15.67:3300/0 conn(0x7f6f340c0aa0 msgr2=0x7f6f34062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:00.037 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.028+0000 7f6f33fff700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.67:3300/0 conn(0x7f6f340c0aa0 0x7f6f34062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.029+0000 7f6f33fff700 1 -- 172.21.15.105:0/296110125 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3414e980 con 0x7f6f3414b770 2020-11-20T11:46:00.038 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.029+0000 7f6f33fff700 1 --2- 172.21.15.105:0/296110125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3414b770 0x7f6f340c05b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6f340c36a0 tx=0x7f6f20006f40).ready entity=mon.2 client_cookie=d7732701b442ba11 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.029+0000 7f6f337fe700 1 -- 172.21.15.105:0/296110125 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000dae0 con 0x7f6f3414b770 2020-11-20T11:46:00.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.029+0000 7f6f337fe700 1 -- 172.21.15.105:0/296110125 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000dc40 con 0x7f6f3414b770 2020-11-20T11:46:00.039 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.029+0000 7f6f337fe700 1 -- 172.21.15.105:0/296110125 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000f400 con 0x7f6f3414b770 2020-11-20T11:46:00.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.030+0000 7f6f3af7a700 1 -- 172.21.15.105:0/296110125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3414b770 msgr2=0x7f6f340c05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.040 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.030+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/296110125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3414b770 0x7f6f340c05b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6f340c36a0 tx=0x7f6f20006f40).stop 2020-11-20T11:46:00.044 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 -- 172.21.15.105:0/296110125 shutdown_connections 2020-11-20T11:46:00.044 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.67:3300/0 conn(0x7f6f340c0aa0 0x7f6f34062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.044 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/296110125 >> v2:172.21.15.100:3300/0 conn(0x7f6f3414b390 0x7f6f3414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.045 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/296110125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3414b770 0x7f6f340c05b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.045 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 -- 172.21.15.105:0/296110125 >> 172.21.15.105:0/296110125 conn(0x7f6f340b9910 msgr2=0x7f6f340b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.046 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.039+0000 7f6f3af7a700 1 -- 172.21.15.105:0/296110125 shutdown_connections 2020-11-20T11:46:00.046 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.040+0000 7f6f3af7a700 1 -- 172.21.15.105:0/296110125 wait complete. 2020-11-20T11:46:00.052 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.041+0000 7f6f3af7a700 1 Processor -- start 2020-11-20T11:46:00.052 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.041+0000 7f6f3af7a700 1 -- start start 2020-11-20T11:46:00.052 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.053 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 0x7f6f34147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.053 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3414b770 0x7f6f34144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.054 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3414d640 con 0x7f6f3414b770 2020-11-20T11:46:00.054 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415d180 con 0x7f6f3414b390 2020-11-20T11:46:00.054 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3414bb50 con 0x7f6f340c0aa0 2020-11-20T11:46:00.055 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.055 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42410/0 (socket says 172.21.15.105:42410) 2020-11-20T11:46:00.056 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 -- 172.21.15.105:0/1396360971 learned_addr learned my addr 172.21.15.105:0/1396360971 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:00.056 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f33fff700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 0x7f6f34147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.056 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f39517700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3414b770 0x7f6f34144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.057 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 -- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 msgr2=0x7f6f34147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.057 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 0x7f6f34147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.058 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 -- 172.21.15.105:0/1396360971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3414b770 msgr2=0x7f6f34144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.058 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3414b770 0x7f6f34144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.058 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 -- 172.21.15.105:0/1396360971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3414d830 con 0x7f6f340c0aa0 2020-11-20T11:46:00.059 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f33fff700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 0x7f6f34147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:00.059 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f38d16700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f6f28012e70 tx=0x7f6f28011040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.060 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28014040 con 0x7f6f340c0aa0 2020-11-20T11:46:00.060 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28009bc0 con 0x7f6f340c0aa0 2020-11-20T11:46:00.060 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28019440 con 0x7f6f340c0aa0 2020-11-20T11:46:00.061 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.042+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3414df30 con 0x7f6f340c0aa0 2020-11-20T11:46:00.061 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.043+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3414da90 con 0x7f6f340c0aa0 2020-11-20T11:46:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.043+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34044f60 con 0x7f6f340c0aa0 2020-11-20T11:46:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.044+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6f280197b0 con 0x7f6f340c0aa0 2020-11-20T11:46:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.044+0000 7f6f30ff9700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 0x7f6f0c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.045+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6f280a6f10 con 0x7f6f340c0aa0 2020-11-20T11:46:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.045+0000 7f6f33fff700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 0x7f6f0c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.045+0000 7f6f33fff700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 0x7f6f0c082af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6f340c36a0 tx=0x7f6f20016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.064 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.048+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6f2807b920 con 0x7f6f340c0aa0 2020-11-20T11:46:00.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.286+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f3414dc90 con 0x7f6f0c080630 2020-11-20T11:46:00.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.286+0000 7f6f30ff9700 1 -- 172.21.15.105:0/1396360971 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f3414dc90 con 0x7f6f0c080630 2020-11-20T11:46:00.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 msgr2=0x7f6f0c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 0x7f6f0c082af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6f340c36a0 tx=0x7f6f20016000).stop 2020-11-20T11:46:00.293 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 msgr2=0x7f6f3415cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f6f28012e70 tx=0x7f6f28011040).stop 2020-11-20T11:46:00.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 shutdown_connections 2020-11-20T11:46:00.294 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3414b770 0x7f6f34144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6f0c080630 0x7f6f0c082af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.295 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f340c0aa0 0x7f6f3415cc90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 --2- 172.21.15.105:0/1396360971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f3414b390 0x7f6f34147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 >> 172.21.15.105:0/1396360971 conn(0x7f6f340b9910 msgr2=0x7f6f340be9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.296 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 shutdown_connections 2020-11-20T11:46:00.297 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.288+0000 7f6f3af7a700 1 -- 172.21.15.105:0/1396360971 wait complete. 2020-11-20T11:46:00.297 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 9 to deep-scrub 2020-11-20T11:46:00.305 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T11:46:00.305 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:00.472 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.468+0000 7f2f2cb1e700 1 Processor -- start 2020-11-20T11:46:00.473 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.469+0000 7f2f2cb1e700 1 -- start start 2020-11-20T11:46:00.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.469+0000 7f2f2cb1e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f280675b0 0x7f2f28067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2cb1e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f280bfc70 0x7f2f280c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.476 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2cb1e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280be280 con 0x7f2f280654d0 2020-11-20T11:46:00.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2cb1e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2814e300 con 0x7f2f280bfc70 2020-11-20T11:46:00.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2cb1e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2814e5a0 con 0x7f2f280675b0 2020-11-20T11:46:00.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f280675b0 0x7f2f28067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.477 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f26d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f280bfc70 0x7f2f280c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f280675b0 0x7f2f28067990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60546/0 (socket says 172.21.15.105:60546) 2020-11-20T11:46:00.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 -- 172.21.15.105:0/3949948410 learned_addr learned my addr 172.21.15.105:0/3949948410 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:00.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 -- 172.21.15.105:0/3949948410 >> v2:172.21.15.67:3300/0 conn(0x7f2f280bfc70 msgr2=0x7f2f280c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:00.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 --2- 172.21.15.105:0/3949948410 >> v2:172.21.15.67:3300/0 conn(0x7f2f280bfc70 0x7f2f280c00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.478 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 -- 172.21.15.105:0/3949948410 >> v1:172.21.15.67:6789/0 conn(0x7f2f280654d0 legacy=0x7f2f28065940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:46:00.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 -- 172.21.15.105:0/3949948410 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2814e840 con 0x7f2f280675b0 2020-11-20T11:46:00.479 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.470+0000 7f2f2659c700 1 --2- 172.21.15.105:0/3949948410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 0x7f2f28067990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2f28061bf0 tx=0x7f2f18006eb0).ready entity=mon.1 client_cookie=76294b8449966340 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.475+0000 7f2f25d9b700 1 -- 172.21.15.105:0/3949948410 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18009860 con 0x7f2f280675b0 2020-11-20T11:46:00.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.476+0000 7f2f25d9b700 1 -- 172.21.15.105:0/3949948410 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180099c0 con 0x7f2f280675b0 2020-11-20T11:46:00.480 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.476+0000 7f2f25d9b700 1 -- 172.21.15.105:0/3949948410 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18009d40 con 0x7f2f280675b0 2020-11-20T11:46:00.484 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.480+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/3949948410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 msgr2=0x7f2f28067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.484 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.480+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/3949948410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 0x7f2f28067990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2f28061bf0 tx=0x7f2f18006eb0).stop 2020-11-20T11:46:00.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.484+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/3949948410 shutdown_connections 2020-11-20T11:46:00.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.484+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/3949948410 >> v2:172.21.15.67:3300/0 conn(0x7f2f280bfc70 0x7f2f280c00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.484+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/3949948410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 0x7f2f28067990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.488 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.484+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/3949948410 >> 172.21.15.105:0/3949948410 conn(0x7f2f28060130 msgr2=0x7f2f28060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.490 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.486+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/3949948410 shutdown_connections 2020-11-20T11:46:00.490 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.486+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/3949948410 wait complete. 2020-11-20T11:46:00.491 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.488+0000 7f2f2cb1e700 1 Processor -- start 2020-11-20T11:46:00.492 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.488+0000 7f2f2cb1e700 1 -- start start 2020-11-20T11:46:00.494 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 0x7f2f2815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.494 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 0x7f2f281512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.494 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f280bfc70 0x7f2f28150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815e310 con 0x7f2f280bfc70 2020-11-20T11:46:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28151b40 con 0x7f2f280675b0 2020-11-20T11:46:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2cb1e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28151de0 con 0x7f2f280654d0 2020-11-20T11:46:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 0x7f2f2815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 0x7f2f2815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42422/0 (socket says 172.21.15.105:42422) 2020-11-20T11:46:00.496 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.489+0000 7f2f2659c700 1 -- 172.21.15.105:0/2033595350 learned_addr learned my addr 172.21.15.105:0/2033595350 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:00.496 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f26d9d700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f280bfc70 0x7f2f28150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.496 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 -- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 msgr2=0x7f2f281512f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:46:00.496 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f280675b0 0x7f2f281512f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:00.497 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 -- 172.21.15.105:0/2033595350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f280bfc70 msgr2=0x7f2f28150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.497 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f280bfc70 0x7f2f28150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.498 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28152080 con 0x7f2f280654d0 2020-11-20T11:46:00.498 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2659c700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 0x7f2f2815de20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2f2814e6e0 tx=0x7f2f18015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.498 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18011e30 con 0x7f2f280654d0 2020-11-20T11:46:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1801e460 con 0x7f2f280654d0 2020-11-20T11:46:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f28152320 con 0x7f2f280654d0 2020-11-20T11:46:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.490+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1801e820 con 0x7f2f280654d0 2020-11-20T11:46:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.492+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f280c2f40 con 0x7f2f280654d0 2020-11-20T11:46:00.501 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.492+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f28044f60 con 0x7f2f280654d0 2020-11-20T11:46:00.501 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2f18025030 con 0x7f2f280654d0 2020-11-20T11:46:00.501 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2f04080630 0x7f2f04082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.501 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2f180ac400 con 0x7f2f280654d0 2020-11-20T11:46:00.501 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f2f040892e0 0x7f2f0408b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f0408bd60 con 0x7f2f040892e0 2020-11-20T11:46:00.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f180a7070 con 0x7f2f280654d0 2020-11-20T11:46:00.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.493+0000 7f2f1ffff700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2f04080630 0x7f2f04082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.502 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.494+0000 7f2f26d9d700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f2f040892e0 0x7f2f0408b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.494+0000 7f2f1ffff700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2f04080630 0x7f2f04082af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2f2814b090 tx=0x7f2f100068a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.494+0000 7f2f26d9d700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f2f040892e0 0x7f2f0408b700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.503 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.495+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== osd.1 v2:172.21.15.100:6802/24705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f2f0408bd60 con 0x7f2f040892e0 2020-11-20T11:46:00.518 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 --> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2f2805cc80 con 0x7f2f040892e0 2020-11-20T11:46:00.519 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f1e7fc700 1 -- 172.21.15.105:0/2033595350 <== osd.1 v2:172.21.15.100:6802/24705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2f2805cc80 con 0x7f2f040892e0 2020-11-20T11:46:00.519 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:00.519 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:00.519 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:00.521 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f2f040892e0 msgr2=0x7f2f0408b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.521 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6802/24705,v1:172.21.15.100:6803/24705] conn(0x7f2f040892e0 0x7f2f0408b700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.521 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2f04080630 msgr2=0x7f2f04082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.521 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2f04080630 0x7f2f04082af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2f2814b090 tx=0x7f2f100068a0).stop 2020-11-20T11:46:00.522 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 msgr2=0x7f2f2815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.522 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f2cb1e700 1 --2- 172.21.15.105:0/2033595350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f280654d0 0x7f2f2815de20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2f2814e6e0 tx=0x7f2f18015000).stop 2020-11-20T11:46:00.522 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.515+0000 7f2f26d9d700 1 -- 172.21.15.105:0/2033595350 reap_dead start 2020-11-20T11:46:00.522 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.516+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 shutdown_connections 2020-11-20T11:46:00.522 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.516+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 >> 172.21.15.105:0/2033595350 conn(0x7f2f28060130 msgr2=0x7f2f2814a710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.523 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.516+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 shutdown_connections 2020-11-20T11:46:00.523 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.516+0000 7f2f2cb1e700 1 -- 172.21.15.105:0/2033595350 wait complete. 2020-11-20T11:46:00.531 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T11:46:00.681 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.678+0000 7fc78346a700 1 Processor -- start 2020-11-20T11:46:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.678+0000 7fc78346a700 1 -- start start 2020-11-20T11:46:00.683 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc78346a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc77c0c25b0 0x7fc77c067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc78346a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c062260 con 0x7fc77c067380 2020-11-20T11:46:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc78346a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c062500 con 0x7fc77c061d20 2020-11-20T11:46:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc78346a700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0627a0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc781a07700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc77c061d20 0x7fc77c0667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42034/0 (socket says 172.21.15.105:42034) 2020-11-20T11:46:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc781a07700 1 -- 172.21.15.105:0/1693923723 learned_addr learned my addr 172.21.15.105:0/1693923723 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:00.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc780a05700 1 --2- 172.21.15.105:0/1693923723 >> v2:172.21.15.100:3300/0 conn(0x7fc77c0c25b0 0x7fc77c067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc780a05700 1 -- 172.21.15.105:0/1693923723 >> v1:172.21.15.105:6789/0 conn(0x7fc77c061d20 legacy=0x7fc77c0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc780a05700 1 -- 172.21.15.105:0/1693923723 >> v1:172.21.15.67:6789/0 conn(0x7fc77c067380 legacy=0x7fc77c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.685 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc76bfff700 1 -- 172.21.15.105:0/1693923723 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864326874 0 0) 0x7fc77c062500 con 0x7fc77c061d20 2020-11-20T11:46:00.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc780a05700 1 -- 172.21.15.105:0/1693923723 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c1513e0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.679+0000 7fc780a05700 1 --2- 172.21.15.105:0/1693923723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c25b0 0x7fc77c067760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc77800b9a0 tx=0x7fc778006df0).ready entity=mon.1 client_cookie=964111babae436b9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.680+0000 7fc76bfff700 1 -- 172.21.15.105:0/1693923723 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778009840 con 0x7fc77c0c25b0 2020-11-20T11:46:00.686 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.680+0000 7fc76bfff700 1 -- 172.21.15.105:0/1693923723 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780099a0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.680+0000 7fc76bfff700 1 -- 172.21.15.105:0/1693923723 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778009d20 con 0x7fc77c0c25b0 2020-11-20T11:46:00.689 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.680+0000 7fc78346a700 1 -- 172.21.15.105:0/1693923723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c25b0 msgr2=0x7fc77c067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.680+0000 7fc78346a700 1 --2- 172.21.15.105:0/1693923723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c25b0 0x7fc77c067760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc77800b9a0 tx=0x7fc778006df0).stop 2020-11-20T11:46:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.683+0000 7fc78346a700 1 -- 172.21.15.105:0/1693923723 shutdown_connections 2020-11-20T11:46:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.683+0000 7fc78346a700 1 --2- 172.21.15.105:0/1693923723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c25b0 0x7fc77c067760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.683+0000 7fc78346a700 1 -- 172.21.15.105:0/1693923723 >> 172.21.15.105:0/1693923723 conn(0x7fc77c0bdd20 msgr2=0x7fc77c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.683+0000 7fc78346a700 1 -- 172.21.15.105:0/1693923723 shutdown_connections 2020-11-20T11:46:00.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.683+0000 7fc78346a700 1 -- 172.21.15.105:0/1693923723 wait complete. 2020-11-20T11:46:00.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.684+0000 7fc78346a700 1 Processor -- start 2020-11-20T11:46:00.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.684+0000 7fc78346a700 1 -- start start 2020-11-20T11:46:00.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.684+0000 7fc78346a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c061d20 0x7fc77c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.691 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.684+0000 7fc78346a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc77c067380 0x7fc77c0bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0c1bf0 con 0x7fc77c067380 2020-11-20T11:46:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0c1440 con 0x7fc77c061d20 2020-11-20T11:46:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0c16b0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42440/0 (socket says 172.21.15.105:42440) 2020-11-20T11:46:00.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 -- 172.21.15.105:0/2104565282 learned_addr learned my addr 172.21.15.105:0/2104565282 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:00.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781206700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c061d20 0x7fc77c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.693 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc780a05700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc77c067380 0x7fc77c0bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 -- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c061d20 msgr2=0x7fc77c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c061d20 0x7fc77c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 -- 172.21.15.105:0/2104565282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc77c067380 msgr2=0x7fc77c0bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc77c067380 0x7fc77c0bf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.694 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 -- 172.21.15.105:0/2104565282 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0c1950 con 0x7fc77c0c25b0 2020-11-20T11:46:00.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc781a07700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc77400cab0 tx=0x7fc774007d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774005b80 con 0x7fc77c0c25b0 2020-11-20T11:46:00.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774005ce0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774007360 con 0x7fc77c0c25b0 2020-11-20T11:46:00.695 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c0bed60 con 0x7fc77c0c25b0 2020-11-20T11:46:00.696 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.685+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c0bf2a0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.697 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.687+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c1515c0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.697 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.687+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc774010030 con 0x7fc77c0c25b0 2020-11-20T11:46:00.697 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.688+0000 7fc7697fa700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 0x7fc754082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:00.697 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.688+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc7740a28d0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.698 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.688+0000 7fc781206700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 0x7fc754082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:00.698 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.688+0000 7fc781206700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 0x7fc754082af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fc76c0035f0 tx=0x7fc76c007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:00.698 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.691+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc7740772e0 con 0x7fc77c0c25b0 2020-11-20T11:46:00.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.898+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc77c0bf4a0 con 0x7fc754080630 2020-11-20T11:46:00.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.898+0000 7fc7697fa700 1 -- 172.21.15.105:0/2104565282 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc76c015410 con 0x7fc754080630 2020-11-20T11:46:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 msgr2=0x7fc754082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 0x7fc754082af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fc76c0035f0 tx=0x7fc76c007b90).stop 2020-11-20T11:46:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 msgr2=0x7fc77c161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc77400cab0 tx=0x7fc774007d80).stop 2020-11-20T11:46:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 shutdown_connections 2020-11-20T11:46:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fc754080630 0x7fc754082af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77c0c25b0 0x7fc77c161370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c061d20 0x7fc77c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 --2- 172.21.15.105:0/2104565282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc77c067380 0x7fc77c0bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:00.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 >> 172.21.15.105:0/2104565282 conn(0x7fc77c0bdd20 msgr2=0x7fc77c0be100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:00.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 shutdown_connections 2020-11-20T11:46:00.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:00.900+0000 7fc78346a700 1 -- 172.21.15.105:0/2104565282 wait complete. 2020-11-20T11:46:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T11:46:00.915 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T11:46:00.915 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:01.084 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.081+0000 7f66254b4700 1 Processor -- start 2020-11-20T11:46:01.085 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.081+0000 7f66254b4700 1 -- start start 2020-11-20T11:46:01.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f66254b4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66200c4000 0x7f66200c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f66254b4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6620155590 con 0x7f6620150520 2020-11-20T11:46:01.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f66254b4700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6620151350 con 0x7f6620155100 2020-11-20T11:46:01.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f66254b4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66201515f0 con 0x7f66200c4000 2020-11-20T11:46:01.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f661f7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6620155100 0x7f66200bef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42052/0 (socket says 172.21.15.105:42052) 2020-11-20T11:46:01.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f661f7fe700 1 -- 172.21.15.105:0/505337727 learned_addr learned my addr 172.21.15.105:0/505337727 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:01.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.082+0000 7f661ffff700 1 --2- 172.21.15.105:0/505337727 >> v2:172.21.15.67:3300/0 conn(0x7f66200c4000 0x7f66200c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239490446 0 0) 0x7f6620151350 con 0x7f6620155100 2020-11-20T11:46:01.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f660c003240 con 0x7f6620155100 2020-11-20T11:46:01.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661ffff700 1 -- 172.21.15.105:0/505337727 >> v1:172.21.15.105:6789/0 conn(0x7f6620155100 legacy=0x7f66200bef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3152434948 0 0) 0x7f660c003240 con 0x7f6620155100 2020-11-20T11:46:01.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661ffff700 1 -- 172.21.15.105:0/505337727 >> v1:172.21.15.67:6789/0 conn(0x7f6620150520 legacy=0x7f6620150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661ffff700 1 -- 172.21.15.105:0/505337727 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620151890 con 0x7f66200c4000 2020-11-20T11:46:01.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661ffff700 1 --2- 172.21.15.105:0/505337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c43e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f661000b9a0 tx=0x7f6610006df0).ready entity=mon.0 client_cookie=d5de433d8eab5424 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140014e0 con 0x7f66200c4000 2020-11-20T11:46:01.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610012460 con 0x7f66200c4000 2020-11-20T11:46:01.090 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.083+0000 7f661effd700 1 -- 172.21.15.105:0/505337727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100127e0 con 0x7f66200c4000 2020-11-20T11:46:01.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 -- 172.21.15.105:0/505337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 msgr2=0x7f66200c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 --2- 172.21.15.105:0/505337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c43e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f661000b9a0 tx=0x7f6610006df0).stop 2020-11-20T11:46:01.093 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 -- 172.21.15.105:0/505337727 shutdown_connections 2020-11-20T11:46:01.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 --2- 172.21.15.105:0/505337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c43e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 -- 172.21.15.105:0/505337727 >> 172.21.15.105:0/505337727 conn(0x7f6620066cc0 msgr2=0x7f66200670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 -- 172.21.15.105:0/505337727 shutdown_connections 2020-11-20T11:46:01.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.084+0000 7f66254b4700 1 -- 172.21.15.105:0/505337727 wait complete. 2020-11-20T11:46:01.094 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.085+0000 7f66254b4700 1 Processor -- start 2020-11-20T11:46:01.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.085+0000 7f66254b4700 1 -- start start 2020-11-20T11:46:01.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620150520 0x7f662013d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6620155100 0x7f662013d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.095 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200c6540 con 0x7f66200c4000 2020-11-20T11:46:01.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200c6770 con 0x7f6620150520 2020-11-20T11:46:01.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.086+0000 7f66254b4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200c6a10 con 0x7f6620155100 2020-11-20T11:46:01.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.096 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f6624cb3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6620155100 0x7f662013d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45746/0 (socket says 172.21.15.105:45746) 2020-11-20T11:46:01.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 -- 172.21.15.105:0/534968531 learned_addr learned my addr 172.21.15.105:0/534968531 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:01.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f6624cb3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6620155100 0x7f662013d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42454/0 (socket says 172.21.15.105:42454) 2020-11-20T11:46:01.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661f7fe700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620150520 0x7f662013d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 -- 172.21.15.105:0/534968531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6620155100 msgr2=0x7f662013d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6620155100 0x7f662013d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 -- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620150520 msgr2=0x7f662013d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620150520 0x7f662013d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200c6cb0 con 0x7f66200c4000 2020-11-20T11:46:01.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661f7fe700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620150520 0x7f662013d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:01.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f661ffff700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c2470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6610006e30 tx=0x7f66201514e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610009b10 con 0x7f66200c4000 2020-11-20T11:46:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610009c70 con 0x7f66200c4000 2020-11-20T11:46:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66200c6f50 con 0x7f66200c4000 2020-11-20T11:46:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661001f410 con 0x7f66200c4000 2020-11-20T11:46:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.087+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662013da70 con 0x7f66200c4000 2020-11-20T11:46:01.101 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.088+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66200c7570 con 0x7f66200c4000 2020-11-20T11:46:01.101 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.089+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f661000f030 con 0x7f66200c4000 2020-11-20T11:46:01.101 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f65fffff700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f65f8080630 0x7f65f8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.102 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6610018030 con 0x7f66200c4000 2020-11-20T11:46:01.102 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f661f7fe700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f65f8080630 0x7f65f8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.103 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f65fffff700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f65f8089360 0x7f65f808b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.103 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65f808bde0 con 0x7f65f8089360 2020-11-20T11:46:01.103 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66100a5bc0 con 0x7f66200c4000 2020-11-20T11:46:01.103 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.090+0000 7f661f7fe700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f65f8080630 0x7f65f8082af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f66201525f0 tx=0x7f6614001620).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.099+0000 7f6624cb3700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f65f8089360 0x7f65f808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.100+0000 7f6624cb3700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f65f8089360 0x7f65f808b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.102+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== osd.4 v2:172.21.15.100:6810/24706 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f65f808bde0 con 0x7f65f8089360 2020-11-20T11:46:01.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.120+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 --> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66200c76e0 con 0x7f65f8089360 2020-11-20T11:46:01.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f65fffff700 1 -- 172.21.15.105:0/534968531 <== osd.4 v2:172.21.15.100:6810/24706 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f66200c76e0 con 0x7f65f8089360 2020-11-20T11:46:01.138 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f65f8089360 msgr2=0x7f65f808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6810/24706,v1:172.21.15.100:6812/24706] conn(0x7f65f8089360 0x7f65f808b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f65f8080630 msgr2=0x7f65f8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f65f8080630 0x7f65f8082af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f66201525f0 tx=0x7f6614001620).stop 2020-11-20T11:46:01.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 msgr2=0x7f66200c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.139 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 --2- 172.21.15.105:0/534968531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66200c4000 0x7f66200c2470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6610006e30 tx=0x7f66201514e0).stop 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f6624cb3700 1 -- 172.21.15.105:0/534968531 reap_dead start 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 shutdown_connections 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 >> 172.21.15.105:0/534968531 conn(0x7f6620066cc0 msgr2=0x7f6620064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 shutdown_connections 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.134+0000 7f66254b4700 1 -- 172.21.15.105:0/534968531 wait complete. 2020-11-20T11:46:01.141 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:01.141 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:01.141 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:01.151 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T11:46:01.300 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.296+0000 7f697da83700 1 Processor -- start 2020-11-20T11:46:01.301 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.296+0000 7f697da83700 1 -- start start 2020-11-20T11:46:01.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f697da83700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f69780c3df0 0x7f697814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f697da83700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978066d60 con 0x7f69780c33a0 2020-11-20T11:46:01.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f697da83700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978067000 con 0x7f69780c3a10 2020-11-20T11:46:01.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f697da83700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780672a0 con 0x7f69780c3df0 2020-11-20T11:46:01.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f69777fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69780c3a10 0x7f697814a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:32848/0 (socket says 172.21.15.105:32848) 2020-11-20T11:46:01.304 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f69777fe700 1 -- 172.21.15.105:0/110214420 learned_addr learned my addr 172.21.15.105:0/110214420 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:01.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.298+0000 7f6976ffd700 1 --2- 172.21.15.105:0/110214420 >> v2:172.21.15.67:3300/0 conn(0x7f69780c3df0 0x7f697814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f6976ffd700 1 -- 172.21.15.105:0/110214420 >> v1:172.21.15.100:6789/0 conn(0x7f69780c3a10 legacy=0x7f697814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:01.305 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f6976ffd700 1 -- 172.21.15.105:0/110214420 >> v1:172.21.15.67:6789/0 conn(0x7f69780c33a0 legacy=0x7f69780bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:01.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f6976ffd700 1 -- 172.21.15.105:0/110214420 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978067540 con 0x7f69780c3df0 2020-11-20T11:46:01.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f6976ffd700 1 --2- 172.21.15.105:0/110214420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c3df0 0x7f697814dd40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f696800b9a0 tx=0x7f6968006df0).ready entity=mon.0 client_cookie=1b7bc90f49ab6ad3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f69767fc700 1 -- 172.21.15.105:0/110214420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680097c0 con 0x7f69780c3df0 2020-11-20T11:46:01.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f69767fc700 1 -- 172.21.15.105:0/110214420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968009920 con 0x7f69780c3df0 2020-11-20T11:46:01.306 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.299+0000 7f69767fc700 1 -- 172.21.15.105:0/110214420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968009ca0 con 0x7f69780c3df0 2020-11-20T11:46:01.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.300+0000 7f697da83700 1 -- 172.21.15.105:0/110214420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c3df0 msgr2=0x7f697814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.307 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.300+0000 7f697da83700 1 --2- 172.21.15.105:0/110214420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c3df0 0x7f697814dd40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f696800b9a0 tx=0x7f6968006df0).stop 2020-11-20T11:46:01.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.302+0000 7f697da83700 1 -- 172.21.15.105:0/110214420 shutdown_connections 2020-11-20T11:46:01.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.302+0000 7f697da83700 1 --2- 172.21.15.105:0/110214420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c3df0 0x7f697814dd40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.302+0000 7f697da83700 1 -- 172.21.15.105:0/110214420 >> 172.21.15.105:0/110214420 conn(0x7f69780b9910 msgr2=0x7f69780b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.303+0000 7f697da83700 1 -- 172.21.15.105:0/110214420 shutdown_connections 2020-11-20T11:46:01.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.303+0000 7f697da83700 1 -- 172.21.15.105:0/110214420 wait complete. 2020-11-20T11:46:01.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 Processor -- start 2020-11-20T11:46:01.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 -- start start 2020-11-20T11:46:01.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 0x7f69780baad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978132310 con 0x7f69780c33a0 2020-11-20T11:46:01.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814ed60 con 0x7f69780c3a10 2020-11-20T11:46:01.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.304+0000 7f697da83700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814e6a0 con 0x7f69780c3df0 2020-11-20T11:46:01.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f6976ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 0x7f69780baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f6977fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45762/0 (socket says 172.21.15.105:45762) 2020-11-20T11:46:01.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f6977fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42470/0 (socket says 172.21.15.105:42470) 2020-11-20T11:46:01.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f6976ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 0x7f69780baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60596/0 (socket says 172.21.15.105:60596) 2020-11-20T11:46:01.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 -- 172.21.15.105:0/3390948399 learned_addr learned my addr 172.21.15.105:0/3390948399 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:01.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 -- 172.21.15.105:0/3390948399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 msgr2=0x7f6978137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.314 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 -- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 msgr2=0x7f69780baad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 0x7f69780baad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 -- 172.21.15.105:0/3390948399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697814efc0 con 0x7f69780c33a0 2020-11-20T11:46:01.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f6977fff700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:01.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.305+0000 7f69777fe700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f697000bab0 tx=0x7f69700091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.309+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000c830 con 0x7f69780c33a0 2020-11-20T11:46:01.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.309+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000c9b0 con 0x7f69780c33a0 2020-11-20T11:46:01.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.309+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697814f260 con 0x7f69780c33a0 2020-11-20T11:46:01.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.309+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000cd70 con 0x7f69780c33a0 2020-11-20T11:46:01.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.309+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978132540 con 0x7f69780c33a0 2020-11-20T11:46:01.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.311+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6970015680 con 0x7f69780c33a0 2020-11-20T11:46:01.318 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.311+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6978044f60 con 0x7f69780c33a0 2020-11-20T11:46:01.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.312+0000 7f69577fe700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 0x7f6950082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.312+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f69700a2800 con 0x7f69780c33a0 2020-11-20T11:46:01.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.312+0000 7f6976ffd700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 0x7f6950082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.319 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.312+0000 7f6976ffd700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 0x7f6950082af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f696800b150 tx=0x7f6968015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.316+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6970077190 con 0x7f69780c33a0 2020-11-20T11:46:01.560 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.556+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f69780668e0 con 0x7f6950080630 2020-11-20T11:46:01.560 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.557+0000 7f69577fe700 1 -- 172.21.15.105:0/3390948399 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f69780668e0 con 0x7f6950080630 2020-11-20T11:46:01.562 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 msgr2=0x7f6950082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.563 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 0x7f6950082af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f696800b150 tx=0x7f6968015000).stop 2020-11-20T11:46:01.563 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 msgr2=0x7f69780bbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.563 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f697000bab0 tx=0x7f69700091a0).stop 2020-11-20T11:46:01.564 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 shutdown_connections 2020-11-20T11:46:01.565 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f6950080630 0x7f6950082af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.565 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69780c3df0 0x7f6978137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.565 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69780c33a0 0x7f69780bbef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.565 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 --2- 172.21.15.105:0/3390948399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69780c3a10 0x7f69780baad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 >> 172.21.15.105:0/3390948399 conn(0x7f69780b9910 msgr2=0x7f69780c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 shutdown_connections 2020-11-20T11:46:01.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.559+0000 7f697da83700 1 -- 172.21.15.105:0/3390948399 wait complete. 2020-11-20T11:46:01.566 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T11:46:01.576 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T11:46:01.577 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:01.718 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.714+0000 7f4975649700 1 Processor -- start 2020-11-20T11:46:01.718 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.714+0000 7f4975649700 1 -- start start 2020-11-20T11:46:01.720 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.715+0000 7f4975649700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f497014e600 0x7f497014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.715+0000 7f4975649700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49700bcef0 con 0x7f49700bca80 2020-11-20T11:46:01.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.715+0000 7f4975649700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4970067460 con 0x7f49700c6230 2020-11-20T11:46:01.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.715+0000 7f4975649700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4970067700 con 0x7f497014e600 2020-11-20T11:46:01.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.715+0000 7f496e7fc700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f49700c6230 0x7f497009b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42082/0 (socket says 172.21.15.105:42082) 2020-11-20T11:46:01.721 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496e7fc700 1 -- 172.21.15.105:0/3726924170 learned_addr learned my addr 172.21.15.105:0/3726924170 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:01.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496effd700 1 --2- 172.21.15.105:0/3726924170 >> v2:172.21.15.100:3300/0 conn(0x7f497014e600 0x7f497014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.722 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400058016 0 0) 0x7f4970067460 con 0x7f49700c6230 2020-11-20T11:46:01.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f495c003240 con 0x7f49700c6230 2020-11-20T11:46:01.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506201900 0 0) 0x7f49700bcef0 con 0x7f49700bca80 2020-11-20T11:46:01.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4970067460 con 0x7f49700bca80 2020-11-20T11:46:01.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496effd700 1 -- 172.21.15.105:0/3726924170 >> v1:172.21.15.105:6789/0 conn(0x7f49700c6230 legacy=0x7f497009b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.723 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496effd700 1 -- 172.21.15.105:0/3726924170 >> v1:172.21.15.100:6789/0 conn(0x7f49700bca80 legacy=0x7f4970154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496effd700 1 -- 172.21.15.105:0/3726924170 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700679a0 con 0x7f497014e600 2020-11-20T11:46:01.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.716+0000 7f496effd700 1 --2- 172.21.15.105:0/3726924170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f497014e600 0x7f497014e9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f496000b990 tx=0x7f4960006d90).ready entity=mon.1 client_cookie=5ae3e67664d0a595 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960006030 con 0x7f497014e600 2020-11-20T11:46:01.724 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960006190 con 0x7f497014e600 2020-11-20T11:46:01.725 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f496dffb700 1 -- 172.21.15.105:0/3726924170 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960006510 con 0x7f497014e600 2020-11-20T11:46:01.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 -- 172.21.15.105:0/3726924170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f497014e600 msgr2=0x7f497014e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 --2- 172.21.15.105:0/3726924170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f497014e600 0x7f497014e9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f496000b990 tx=0x7f4960006d90).stop 2020-11-20T11:46:01.726 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 -- 172.21.15.105:0/3726924170 shutdown_connections 2020-11-20T11:46:01.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 --2- 172.21.15.105:0/3726924170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f497014e600 0x7f497014e9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 -- 172.21.15.105:0/3726924170 >> 172.21.15.105:0/3726924170 conn(0x7f4970060bc0 msgr2=0x7f49700c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 -- 172.21.15.105:0/3726924170 shutdown_connections 2020-11-20T11:46:01.727 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.717+0000 7f4975649700 1 -- 172.21.15.105:0/3726924170 wait complete. 2020-11-20T11:46:01.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.719+0000 7f4975649700 1 Processor -- start 2020-11-20T11:46:01.728 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.719+0000 7f4975649700 1 -- start start 2020-11-20T11:46:01.731 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 0x7f497014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.732 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49700c6230 0x7f4970167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.732 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497014e600 0x7f4970165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.732 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49701502d0 con 0x7f497014e600 2020-11-20T11:46:01.732 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49701649f0 con 0x7f49700c6230 2020-11-20T11:46:01.733 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f4975649700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4970168770 con 0x7f49700bca80 2020-11-20T11:46:01.733 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 0x7f497014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.733 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 0x7f497014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42480/0 (socket says 172.21.15.105:42480) 2020-11-20T11:46:01.733 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 -- 172.21.15.105:0/4204017607 learned_addr learned my addr 172.21.15.105:0/4204017607 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:01.733 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 -- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49700c6230 msgr2=0x7f4970167f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:46:01.734 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49700c6230 0x7f4970167f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:01.734 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 -- 172.21.15.105:0/4204017607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497014e600 msgr2=0x7f4970165330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:46:01.734 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497014e600 0x7f4970165330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:01.734 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 -- 172.21.15.105:0/4204017607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970168a10 con 0x7f49700bca80 2020-11-20T11:46:01.734 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.720+0000 7f496effd700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 0x7f497014fde0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4960006dd0 tx=0x7f4960015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.735 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.721+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600099a0 con 0x7f49700bca80 2020-11-20T11:46:01.735 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.721+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960009b00 con 0x7f49700bca80 2020-11-20T11:46:01.735 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.721+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960009ea0 con 0x7f49700bca80 2020-11-20T11:46:01.735 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.721+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4970168cb0 con 0x7f49700bca80 2020-11-20T11:46:01.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.721+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4970164e90 con 0x7f49700bca80 2020-11-20T11:46:01.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.723+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f496000f070 con 0x7f49700bca80 2020-11-20T11:46:01.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.724+0000 7f4956ffd700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f494c080630 0x7f494c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.724+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f49600a4860 con 0x7f49700bca80 2020-11-20T11:46:01.736 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.724+0000 7f496e7fc700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f494c080630 0x7f494c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.737 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.725+0000 7f496e7fc700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f494c080630 0x7f494c082af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f49640055a0 tx=0x7f4964001060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.737 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.726+0000 7f4975649700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7f4970061ec0 0x7f49700622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.737 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.726+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 --> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4970062920 con 0x7f4970061ec0 2020-11-20T11:46:01.737 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.726+0000 7f496f7fe700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7f4970061ec0 0x7f49700622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.726+0000 7f496f7fe700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7f4970061ec0 0x7f49700622a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.738 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.727+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== osd.7 v2:172.21.15.100:6811/24707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f4970062920 con 0x7f4970061ec0 2020-11-20T11:46:01.761 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.758+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 --> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4970065110 con 0x7f4970061ec0 2020-11-20T11:46:01.763 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.758+0000 7f4956ffd700 1 -- 172.21.15.105:0/4204017607 <== osd.7 v2:172.21.15.100:6811/24707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4970065110 con 0x7f4970061ec0 2020-11-20T11:46:01.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7f4970061ec0 msgr2=0x7f49700622a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6811/24707,v1:172.21.15.100:6813/24707] conn(0x7f4970061ec0 0x7f49700622a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f494c080630 msgr2=0x7f494c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.764 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f494c080630 0x7f494c082af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f49640055a0 tx=0x7f4964001060).stop 2020-11-20T11:46:01.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 msgr2=0x7f497014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 --2- 172.21.15.105:0/4204017607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49700bca80 0x7f497014fde0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4960006dd0 tx=0x7f4960015000).stop 2020-11-20T11:46:01.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f496f7fe700 1 -- 172.21.15.105:0/4204017607 reap_dead start 2020-11-20T11:46:01.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 shutdown_connections 2020-11-20T11:46:01.765 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 >> 172.21.15.105:0/4204017607 conn(0x7f4970060bc0 msgr2=0x7f497014b750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 shutdown_connections 2020-11-20T11:46:01.766 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.759+0000 7f4975649700 1 -- 172.21.15.105:0/4204017607 wait complete. 2020-11-20T11:46:01.766 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:01.766 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:01.767 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:01.779 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T11:46:01.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.922+0000 7fb133d4d700 1 Processor -- start 2020-11-20T11:46:01.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.922+0000 7fb133d4d700 1 -- start start 2020-11-20T11:46:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb133d4d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb12c067380 0x7fb12c067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb133d4d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb12c061d20 0x7fb12c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb133d4d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c062260 con 0x7fb12c0c25b0 2020-11-20T11:46:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb133d4d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c062500 con 0x7fb12c067380 2020-11-20T11:46:01.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb133d4d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c0627a0 con 0x7fb12c061d20 2020-11-20T11:46:01.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb12c061d20 0x7fb12c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb12c061d20 0x7fb12c0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42486/0 (socket says 172.21.15.105:42486) 2020-11-20T11:46:01.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 -- 172.21.15.105:0/605998525 learned_addr learned my addr 172.21.15.105:0/605998525 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:01.929 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb131ae9700 1 --2- 172.21.15.105:0/605998525 >> v2:172.21.15.100:3300/0 conn(0x7fb12c067380 0x7fb12c067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 -- 172.21.15.105:0/605998525 >> v2:172.21.15.100:3300/0 conn(0x7fb12c067380 msgr2=0x7fb12c067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:01.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 --2- 172.21.15.105:0/605998525 >> v2:172.21.15.100:3300/0 conn(0x7fb12c067380 0x7fb12c067760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 -- 172.21.15.105:0/605998525 >> v1:172.21.15.100:6789/0 conn(0x7fb12c0c25b0 legacy=0x7fb12c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.930 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 -- 172.21.15.105:0/605998525 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c1513e0 con 0x7fb12c061d20 2020-11-20T11:46:01.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb1322ea700 1 --2- 172.21.15.105:0/605998525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c061d20 0x7fb12c0c3a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fb12c0c8280 tx=0x7fb124009290).ready entity=mon.2 client_cookie=e55f1d65798d2d41 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb130ae7700 1 -- 172.21.15.105:0/605998525 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400bbc0 con 0x7fb12c061d20 2020-11-20T11:46:01.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb130ae7700 1 -- 172.21.15.105:0/605998525 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400bd20 con 0x7fb12c061d20 2020-11-20T11:46:01.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.923+0000 7fb130ae7700 1 -- 172.21.15.105:0/605998525 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124011610 con 0x7fb12c061d20 2020-11-20T11:46:01.931 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 -- 172.21.15.105:0/605998525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c061d20 msgr2=0x7fb12c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 --2- 172.21.15.105:0/605998525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c061d20 0x7fb12c0c3a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fb12c0c8280 tx=0x7fb124009290).stop 2020-11-20T11:46:01.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 -- 172.21.15.105:0/605998525 shutdown_connections 2020-11-20T11:46:01.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 --2- 172.21.15.105:0/605998525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c061d20 0x7fb12c0c3a70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 --2- 172.21.15.105:0/605998525 >> v2:172.21.15.100:3300/0 conn(0x7fb12c067380 0x7fb12c067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 -- 172.21.15.105:0/605998525 >> 172.21.15.105:0/605998525 conn(0x7fb12c0bdd20 msgr2=0x7fb12c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:01.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 -- 172.21.15.105:0/605998525 shutdown_connections 2020-11-20T11:46:01.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.924+0000 7fb133d4d700 1 -- 172.21.15.105:0/605998525 wait complete. 2020-11-20T11:46:01.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.925+0000 7fb133d4d700 1 Processor -- start 2020-11-20T11:46:01.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.925+0000 7fb133d4d700 1 -- start start 2020-11-20T11:46:01.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c067380 0x7fb12c0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 0x7fb12c164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c155560 con 0x7fb12c067380 2020-11-20T11:46:01.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c164840 con 0x7fb12c061d20 2020-11-20T11:46:01.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb133d4d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c155020 con 0x7fb12c0c25b0 2020-11-20T11:46:01.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 0x7fb12c164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb131ae9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb131ae9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60620/0 (socket says 172.21.15.105:60620) 2020-11-20T11:46:01.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb131ae9700 1 -- 172.21.15.105:0/2097521539 learned_addr learned my addr 172.21.15.105:0/2097521539 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:01.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1312e8700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c067380 0x7fb12c0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 -- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 msgr2=0x7fb12c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 -- 172.21.15.105:0/2097521539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c067380 msgr2=0x7fb12c0c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:01.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c067380 0x7fb12c0c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:01.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 -- 172.21.15.105:0/2097521539 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c1552c0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb131ae9700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:01.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.926+0000 7fb1322ea700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 0x7fb12c164350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb12c0c8280 tx=0x7fb124016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.927+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400bbc0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.927+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400be90 con 0x7fb12c0c25b0 2020-11-20T11:46:01.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.927+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c1605b0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.927+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124010cf0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.927+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c160af0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.928+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c160cb0 con 0x7fb12c0c25b0 2020-11-20T11:46:01.942 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.929+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb124017070 con 0x7fb12c0c25b0 2020-11-20T11:46:01.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.929+0000 7fb119ffb700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 0x7fb110082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:01.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.929+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb1240a5470 con 0x7fb12c0c25b0 2020-11-20T11:46:01.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.929+0000 7fb131ae9700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 0x7fb110082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:01.943 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.930+0000 7fb131ae9700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 0x7fb110082af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb11c006a90 tx=0x7fb11c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:01.944 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:01.935+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb124079f00 con 0x7fb12c0c25b0 2020-11-20T11:46:02.169 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.166+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12c044f60 con 0x7fb110080630 2020-11-20T11:46:02.170 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.166+0000 7fb119ffb700 1 -- 172.21.15.105:0/2097521539 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb12c044f60 con 0x7fb110080630 2020-11-20T11:46:02.172 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 msgr2=0x7fb110082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.172 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 0x7fb110082af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb11c006a90 tx=0x7fb11c006df0).stop 2020-11-20T11:46:02.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 msgr2=0x7fb12c164350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 0x7fb12c164350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb12c0c8280 tx=0x7fb124016000).stop 2020-11-20T11:46:02.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 shutdown_connections 2020-11-20T11:46:02.173 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fb110080630 0x7fb110082af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb12c0c25b0 0x7fb12c164350 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb12c061d20 0x7fb12c160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 --2- 172.21.15.105:0/2097521539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c067380 0x7fb12c0c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.174 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.169+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 >> 172.21.15.105:0/2097521539 conn(0x7fb12c0bdd20 msgr2=0x7fb12c14ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:02.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.171+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 shutdown_connections 2020-11-20T11:46:02.175 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.171+0000 7fb133d4d700 1 -- 172.21.15.105:0/2097521539 wait complete. 2020-11-20T11:46:02.175 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T11:46:02.188 INFO:tasks.ceph:Scrubbing osd.10 2020-11-20T11:46:02.188 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:02.329 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 Processor -- start 2020-11-20T11:46:02.330 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 -- start start 2020-11-20T11:46:02.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f11ec0c7cb0 0x7f11ec0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f11ec1510d0 0x7f11ec151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec0c36f0 con 0x7f11ec0c78d0 2020-11-20T11:46:02.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec062be0 con 0x7f11ec0c7cb0 2020-11-20T11:46:02.332 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.326+0000 7f11f1430700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec09f5d0 con 0x7f11ec1510d0 2020-11-20T11:46:02.333 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eaffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f11ec0c78d0 0x7f11ec0c2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42104/0 (socket says 172.21.15.105:42104) 2020-11-20T11:46:02.333 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eaffd700 1 -- 172.21.15.105:0/1589163418 learned_addr learned my addr 172.21.15.105:0/1589163418 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:02.333 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/1589163418 >> v2:172.21.15.105:3300/0 conn(0x7f11ec1510d0 0x7f11ec151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.333 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11ea7fc700 1 -- 172.21.15.105:0/1589163418 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867643699 0 0) 0x7f11ec0c36f0 con 0x7f11ec0c78d0 2020-11-20T11:46:02.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11e3fff700 1 --2- 172.21.15.105:0/1589163418 >> v2:172.21.15.67:3300/0 conn(0x7f11ec0c7cb0 0x7f11ec0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11ea7fc700 1 -- 172.21.15.105:0/1589163418 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11cc003240 con 0x7f11ec0c78d0 2020-11-20T11:46:02.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 -- 172.21.15.105:0/1589163418 >> v2:172.21.15.67:3300/0 conn(0x7f11ec0c7cb0 msgr2=0x7f11ec0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:02.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/1589163418 >> v2:172.21.15.67:3300/0 conn(0x7f11ec0c7cb0 0x7f11ec0626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.334 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 -- 172.21.15.105:0/1589163418 >> v1:172.21.15.105:6789/0 conn(0x7f11ec0c78d0 legacy=0x7f11ec0c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 -- 172.21.15.105:0/1589163418 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec154860 con 0x7f11ec1510d0 2020-11-20T11:46:02.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/1589163418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec1510d0 0x7f11ec151560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f11e4009c90 tx=0x7f11e40091d0).ready entity=mon.2 client_cookie=8d780b3752730133 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11ea7fc700 1 -- 172.21.15.105:0/1589163418 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400ba30 con 0x7f11ec1510d0 2020-11-20T11:46:02.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11ea7fc700 1 -- 172.21.15.105:0/1589163418 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e400bb90 con 0x7f11ec1510d0 2020-11-20T11:46:02.335 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.327+0000 7f11ea7fc700 1 -- 172.21.15.105:0/1589163418 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4011400 con 0x7f11ec1510d0 2020-11-20T11:46:02.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 -- 172.21.15.105:0/1589163418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec1510d0 msgr2=0x7f11ec151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 --2- 172.21.15.105:0/1589163418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec1510d0 0x7f11ec151560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f11e4009c90 tx=0x7f11e40091d0).stop 2020-11-20T11:46:02.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 -- 172.21.15.105:0/1589163418 shutdown_connections 2020-11-20T11:46:02.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 --2- 172.21.15.105:0/1589163418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec1510d0 0x7f11ec151560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.336 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 --2- 172.21.15.105:0/1589163418 >> v2:172.21.15.67:3300/0 conn(0x7f11ec0c7cb0 0x7f11ec0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 -- 172.21.15.105:0/1589163418 >> 172.21.15.105:0/1589163418 conn(0x7f11ec0bdca0 msgr2=0x7f11ec0be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:02.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 -- 172.21.15.105:0/1589163418 shutdown_connections 2020-11-20T11:46:02.337 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.328+0000 7f11f1430700 1 -- 172.21.15.105:0/1589163418 wait complete. 2020-11-20T11:46:02.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.329+0000 7f11f1430700 1 Processor -- start 2020-11-20T11:46:02.341 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.329+0000 7f11f1430700 1 -- start start 2020-11-20T11:46:02.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 0x7f11ec14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11ec0c7cb0 0x7f11ec160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1510d0 0x7f11ec14d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.342 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec160910 con 0x7f11ec1510d0 2020-11-20T11:46:02.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec14dad0 con 0x7f11ec0c7cb0 2020-11-20T11:46:02.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11f1430700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec14ed00 con 0x7f11ec0c78d0 2020-11-20T11:46:02.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 0x7f11ec14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 0x7f11ec14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42506/0 (socket says 172.21.15.105:42506) 2020-11-20T11:46:02.343 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 -- 172.21.15.105:0/406331847 learned_addr learned my addr 172.21.15.105:0/406331847 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:02.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1510d0 0x7f11ec14d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11e3fff700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11ec0c7cb0 0x7f11ec160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 -- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11ec0c7cb0 msgr2=0x7f11ec160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.344 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11ec0c7cb0 0x7f11ec160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 -- 172.21.15.105:0/406331847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1510d0 msgr2=0x7f11ec14d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1510d0 0x7f11ec14d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec14c990 con 0x7f11ec0c78d0 2020-11-20T11:46:02.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1510d0 0x7f11ec14d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:02.345 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.330+0000 7f11eaffd700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 0x7f11ec14e080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f11dc00c6e0 tx=0x7f11dc007ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0072e0 con 0x7f11ec0c78d0 2020-11-20T11:46:02.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc007440 con 0x7f11ec0c78d0 2020-11-20T11:46:02.346 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec14cc30 con 0x7f11ec0c78d0 2020-11-20T11:46:02.347 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc005820 con 0x7f11ec0c78d0 2020-11-20T11:46:02.347 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec163a80 con 0x7f11ec0c78d0 2020-11-20T11:46:02.347 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.331+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11ec163900 con 0x7f11ec0c78d0 2020-11-20T11:46:02.348 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.332+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f11dc010070 con 0x7f11ec0c78d0 2020-11-20T11:46:02.348 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e2ffd700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11c8080630 0x7f11c8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.348 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f11dc0a2740 con 0x7f11ec0c78d0 2020-11-20T11:46:02.348 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e3fff700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11c8080630 0x7f11c8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.348 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e2ffd700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f11c8089360 0x7f11c808b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.349 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11c808bde0 con 0x7f11c8089360 2020-11-20T11:46:02.349 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11dc0a2ab0 con 0x7f11ec0c78d0 2020-11-20T11:46:02.349 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.333+0000 7f11e3fff700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11c8080630 0x7f11c8082af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f11ec14c2d0 tx=0x7f11d4006f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.351 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.344+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f11c8089360 0x7f11c808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.351 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.344+0000 7f11eb7fe700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f11c8089360 0x7f11c808b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.351 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.347+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== osd.10 v2:172.21.15.100:6826/24710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f11c808bde0 con 0x7f11c8089360 2020-11-20T11:46:02.369 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.365+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 --> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11ec14d090 con 0x7f11c8089360 2020-11-20T11:46:02.384 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.379+0000 7f11e2ffd700 1 -- 172.21.15.105:0/406331847 <== osd.10 v2:172.21.15.100:6826/24710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f11ec14d090 con 0x7f11c8089360 2020-11-20T11:46:02.385 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:02.385 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:02.386 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:02.388 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.383+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f11c8089360 msgr2=0x7f11c808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.388 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6826/24710,v1:172.21.15.100:6827/24710] conn(0x7f11c8089360 0x7f11c808b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.388 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11c8080630 msgr2=0x7f11c8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.388 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f11c8080630 0x7f11c8082af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f11ec14c2d0 tx=0x7f11d4006f90).stop 2020-11-20T11:46:02.389 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 msgr2=0x7f11ec14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.389 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 --2- 172.21.15.105:0/406331847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11ec0c78d0 0x7f11ec14e080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f11dc00c6e0 tx=0x7f11dc007ac0).stop 2020-11-20T11:46:02.389 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11eb7fe700 1 -- 172.21.15.105:0/406331847 reap_dead start 2020-11-20T11:46:02.390 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 shutdown_connections 2020-11-20T11:46:02.390 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 >> 172.21.15.105:0/406331847 conn(0x7f11ec0bdca0 msgr2=0x7f11ec066fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:02.390 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 shutdown_connections 2020-11-20T11:46:02.390 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.384+0000 7f11f1430700 1 -- 172.21.15.105:0/406331847 wait complete. 2020-11-20T11:46:02.402 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2020-11-20T11:46:02.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.580+0000 7f78799b7700 1 Processor -- start 2020-11-20T11:46:02.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.580+0000 7f78799b7700 1 -- start start 2020-11-20T11:46:02.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.581+0000 7f78799b7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78740c38b0 0x7f78740bf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.581+0000 7f78799b7700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78740bdda0 0x7f78740625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.581+0000 7f78799b7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7874166000 con 0x7f78740c34d0 2020-11-20T11:46:02.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.581+0000 7f78799b7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78741662a0 con 0x7f78740c38b0 2020-11-20T11:46:02.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.581+0000 7f78799b7700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7874166540 con 0x7f78740bdda0 2020-11-20T11:46:02.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78740c38b0 0x7f78740bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f7872ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f78740c34d0 0x7f7874165820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:53582/0 (socket says 172.21.15.105:53582) 2020-11-20T11:46:02.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f7872ffd700 1 -- 172.21.15.105:0/3906127538 learned_addr learned my addr 172.21.15.105:0/3906127538 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:02.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 -- 172.21.15.105:0/3906127538 >> v2:172.21.15.105:3300/0 conn(0x7f78740bdda0 msgr2=0x7f78740625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:02.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 --2- 172.21.15.105:0/3906127538 >> v2:172.21.15.105:3300/0 conn(0x7f78740bdda0 0x7f78740625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:02.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 -- 172.21.15.105:0/3906127538 >> v1:172.21.15.67:6789/0 conn(0x7f78740c34d0 legacy=0x7f7874165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 -- 172.21.15.105:0/3906127538 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874061ea0 con 0x7f78740c38b0 2020-11-20T11:46:02.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f78727fc700 1 --2- 172.21.15.105:0/3906127538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740c38b0 0x7f78740bf660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7874065240 tx=0x7f7864006df0).ready entity=mon.0 client_cookie=185fe5709e213eac server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.582+0000 7f7871ffb700 1 -- 172.21.15.105:0/3906127538 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640097b0 con 0x7f78740c38b0 2020-11-20T11:46:02.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.583+0000 7f7871ffb700 1 -- 172.21.15.105:0/3906127538 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864009910 con 0x7f78740c38b0 2020-11-20T11:46:02.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.583+0000 7f7871ffb700 1 -- 172.21.15.105:0/3906127538 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864009c90 con 0x7f78740c38b0 2020-11-20T11:46:02.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 -- 172.21.15.105:0/3906127538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740c38b0 msgr2=0x7f78740bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 --2- 172.21.15.105:0/3906127538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740c38b0 0x7f78740bf660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7874065240 tx=0x7f7864006df0).stop 2020-11-20T11:46:02.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 -- 172.21.15.105:0/3906127538 shutdown_connections 2020-11-20T11:46:02.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 --2- 172.21.15.105:0/3906127538 >> v2:172.21.15.105:3300/0 conn(0x7f78740bdda0 0x7f78740625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:02.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 --2- 172.21.15.105:0/3906127538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740c38b0 0x7f78740bf660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 -- 172.21.15.105:0/3906127538 >> 172.21.15.105:0/3906127538 conn(0x7f78740b9910 msgr2=0x7f78740b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:02.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 -- 172.21.15.105:0/3906127538 shutdown_connections 2020-11-20T11:46:02.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.584+0000 7f78799b7700 1 -- 172.21.15.105:0/3906127538 wait complete. 2020-11-20T11:46:02.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.585+0000 7f78799b7700 1 Processor -- start 2020-11-20T11:46:02.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.585+0000 7f78799b7700 1 -- start start 2020-11-20T11:46:02.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 0x7f787415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78740c34d0 0x7f78741648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 0x7f787416c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874175a10 con 0x7f78740bdda0 2020-11-20T11:46:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874164da0 con 0x7f78740c34d0 2020-11-20T11:46:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78799b7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874165010 con 0x7f78740c38b0 2020-11-20T11:46:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f7872ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 0x7f787415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.597 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78737fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 0x7f787416c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.597 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78737fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 0x7f787416c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42524/0 (socket says 172.21.15.105:42524) 2020-11-20T11:46:02.597 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78737fe700 1 -- 172.21.15.105:0/4027782214 learned_addr learned my addr 172.21.15.105:0/4027782214 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:02.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.586+0000 7f78727fc700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78740c34d0 0x7f78741648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 -- 172.21.15.105:0/4027782214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 msgr2=0x7f787416c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 0x7f787416c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 -- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78740c34d0 msgr2=0x7f78741648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78740c34d0 0x7f78741648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 -- 172.21.15.105:0/4027782214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874175c00 con 0x7f78740bdda0 2020-11-20T11:46:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f7872ffd700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 0x7f787415f250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f786c00ca90 tx=0x7f786c007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c005b80 con 0x7f78740bdda0 2020-11-20T11:46:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c005ce0 con 0x7f78740bdda0 2020-11-20T11:46:02.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c007360 con 0x7f78740bdda0 2020-11-20T11:46:02.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7874175ea0 con 0x7f78740bdda0 2020-11-20T11:46:02.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.587+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78741763e0 con 0x7f78740bdda0 2020-11-20T11:46:02.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.589+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78741765e0 con 0x7f78740bdda0 2020-11-20T11:46:02.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.590+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f786c010030 con 0x7f78740bdda0 2020-11-20T11:46:02.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.590+0000 7f785affd700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 0x7f7850082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:02.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.590+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f786c0a2970 con 0x7f78740bdda0 2020-11-20T11:46:02.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.590+0000 7f78727fc700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 0x7f7850082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:02.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.591+0000 7f78727fc700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 0x7f7850082af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f786400c010 tx=0x7f7864015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:02.605 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.597+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f78741765e0 con 0x7f78740bdda0 2020-11-20T11:46:02.844 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.841+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7f7874044f60 con 0x7f7850080630 2020-11-20T11:46:02.845 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.841+0000 7f785affd700 1 -- 172.21.15.105:0/4027782214 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f7874044f60 con 0x7f7850080630 2020-11-20T11:46:02.849 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 msgr2=0x7f7850082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 0x7f7850082af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f786400c010 tx=0x7f7864015000).stop 2020-11-20T11:46:02.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 msgr2=0x7f787415f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:02.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 0x7f787415f250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f786c00ca90 tx=0x7f786c007ed0).stop 2020-11-20T11:46:02.850 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 shutdown_connections 2020-11-20T11:46:02.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f7850080630 0x7f7850082af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78740c38b0 0x7f787416c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78740bdda0 0x7f787415f250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 --2- 172.21.15.105:0/4027782214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78740c34d0 0x7f78741648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:02.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.846+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 >> 172.21.15.105:0/4027782214 conn(0x7f78740b9910 msgr2=0x7f787409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:02.852 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.848+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 shutdown_connections 2020-11-20T11:46:02.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:02.848+0000 7f78799b7700 1 -- 172.21.15.105:0/4027782214 wait complete. 2020-11-20T11:46:02.853 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 10 to deep-scrub 2020-11-20T11:46:02.864 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T11:46:02.865 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:03.045 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.041+0000 7f8d474ef700 1 Processor -- start 2020-11-20T11:46:03.046 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.041+0000 7f8d474ef700 1 -- start start 2020-11-20T11:46:03.049 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d474ef700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d400c7cb0 0x7f8d400626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d474ef700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d401510d0 0x7f8d40151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d474ef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400c36f0 con 0x7f8d400c78d0 2020-11-20T11:46:03.566 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d474ef700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d40062be0 con 0x7f8d400c7cb0 2020-11-20T11:46:03.567 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d474ef700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4009f5d0 con 0x7f8d401510d0 2020-11-20T11:46:03.567 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d45a8c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d401510d0 0x7f8d40151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.567 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d45a8c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d401510d0 0x7f8d40151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42534/0 (socket says 172.21.15.105:42534) 2020-11-20T11:46:03.567 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.042+0000 7f8d45a8c700 1 -- 172.21.15.105:0/1196652258 learned_addr learned my addr 172.21.15.105:0/1196652258 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:03.567 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d44a8a700 1 --2- 172.21.15.105:0/1196652258 >> v2:172.21.15.100:3300/0 conn(0x7f8d400c7cb0 0x7f8d400626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.568 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d45a8c700 1 -- 172.21.15.105:0/1196652258 >> v2:172.21.15.100:3300/0 conn(0x7f8d400c7cb0 msgr2=0x7f8d400626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:03.568 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/1196652258 >> v2:172.21.15.100:3300/0 conn(0x7f8d400c7cb0 0x7f8d400626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.568 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d45a8c700 1 -- 172.21.15.105:0/1196652258 >> v1:172.21.15.67:6789/0 conn(0x7f8d400c78d0 legacy=0x7f8d400c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.568 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d45a8c700 1 -- 172.21.15.105:0/1196652258 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40154860 con 0x7f8d401510d0 2020-11-20T11:46:03.568 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/1196652258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d401510d0 0x7f8d40151560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8d3c006fd0 tx=0x7f8d3c006eb0).ready entity=mon.2 client_cookie=437191751c443699 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d2ffff700 1 -- 172.21.15.105:0/1196652258 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0097d0 con 0x7f8d401510d0 2020-11-20T11:46:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d2ffff700 1 -- 172.21.15.105:0/1196652258 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c009930 con 0x7f8d401510d0 2020-11-20T11:46:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.043+0000 7f8d2ffff700 1 -- 172.21.15.105:0/1196652258 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c009cb0 con 0x7f8d401510d0 2020-11-20T11:46:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 -- 172.21.15.105:0/1196652258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d401510d0 msgr2=0x7f8d40151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 --2- 172.21.15.105:0/1196652258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d401510d0 0x7f8d40151560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8d3c006fd0 tx=0x7f8d3c006eb0).stop 2020-11-20T11:46:03.570 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 -- 172.21.15.105:0/1196652258 shutdown_connections 2020-11-20T11:46:03.570 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 --2- 172.21.15.105:0/1196652258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d401510d0 0x7f8d40151560 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.570 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 --2- 172.21.15.105:0/1196652258 >> v2:172.21.15.100:3300/0 conn(0x7f8d400c7cb0 0x7f8d400626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.570 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 -- 172.21.15.105:0/1196652258 >> 172.21.15.105:0/1196652258 conn(0x7f8d400bdca0 msgr2=0x7f8d400be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:03.571 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 -- 172.21.15.105:0/1196652258 shutdown_connections 2020-11-20T11:46:03.571 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.044+0000 7f8d474ef700 1 -- 172.21.15.105:0/1196652258 wait complete. 2020-11-20T11:46:03.571 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.046+0000 7f8d474ef700 1 Processor -- start 2020-11-20T11:46:03.571 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.046+0000 7f8d474ef700 1 -- start start 2020-11-20T11:46:03.575 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d400c78d0 0x7f8d400bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.575 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 0x7f8d401516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.575 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d401510d0 0x7f8d400c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40153710 con 0x7f8d400c78d0 2020-11-20T11:46:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d401528d0 con 0x7f8d401510d0 2020-11-20T11:46:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d474ef700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40152b70 con 0x7f8d400c7cb0 2020-11-20T11:46:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 0x7f8d401516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 0x7f8d401516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42538/0 (socket says 172.21.15.105:42538) 2020-11-20T11:46:03.577 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 -- 172.21.15.105:0/3114481331 learned_addr learned my addr 172.21.15.105:0/3114481331 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:03.577 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d4528b700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d400c78d0 0x7f8d400bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.577 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d401510d0 0x7f8d400c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.577 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 -- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d401510d0 msgr2=0x7f8d400c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d401510d0 0x7f8d400c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 -- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d400c78d0 msgr2=0x7f8d400bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d400c78d0 0x7f8d400bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40152e10 con 0x7f8d400c7cb0 2020-11-20T11:46:03.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d401510d0 0x7f8d400c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:03.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.047+0000 7f8d44a8a700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 0x7f8d401516a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8d3000ebd0 tx=0x7f8d30006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.048+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000b810 con 0x7f8d400c7cb0 2020-11-20T11:46:03.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.048+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3000b970 con 0x7f8d400c7cb0 2020-11-20T11:46:03.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.048+0000 7f8d474ef700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d401530b0 con 0x7f8d400c7cb0 2020-11-20T11:46:03.579 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.048+0000 7f8d474ef700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d401606b0 con 0x7f8d400c7cb0 2020-11-20T11:46:03.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.048+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000bcf0 con 0x7f8d400c7cb0 2020-11-20T11:46:03.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.049+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d10000f80 con 0x7f8d400c7cb0 2020-11-20T11:46:03.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.049+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8d30012600 con 0x7f8d400c7cb0 2020-11-20T11:46:03.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d2d7fa700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8d18080630 0x7f8d18082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.580 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8d300a3800 con 0x7f8d400c7cb0 2020-11-20T11:46:03.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d4528b700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8d18080630 0x7f8d18082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d2d7fa700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f8d18089360 0x7f8d1808b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d1808bde0 con 0x7f8d18089360 2020-11-20T11:46:03.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d300a3b70 con 0x7f8d400c7cb0 2020-11-20T11:46:03.581 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f8d18089360 0x7f8d1808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.050+0000 7f8d4528b700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8d18080630 0x7f8d18082af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8d38000f40 tx=0x7f8d38007ef0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.051+0000 7f8d45a8c700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f8d18089360 0x7f8d1808b780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.052+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== osd.2 v2:172.21.15.67:6824/25159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f8d1808bde0 con 0x7f8d18089360 2020-11-20T11:46:03.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.067+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 --> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d100029f0 con 0x7f8d18089360 2020-11-20T11:46:03.582 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d2d7fa700 1 -- 172.21.15.105:0/3114481331 <== osd.2 v2:172.21.15.67:6824/25159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8d100029f0 con 0x7f8d18089360 2020-11-20T11:46:03.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f8d18089360 msgr2=0x7f8d1808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.67:6824/25159,v1:172.21.15.67:6825/25159] conn(0x7f8d18089360 0x7f8d1808b780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8d18080630 msgr2=0x7f8d18082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f8d18080630 0x7f8d18082af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8d38000f40 tx=0x7f8d38007ef0).stop 2020-11-20T11:46:03.583 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 msgr2=0x7f8d401516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 --2- 172.21.15.105:0/3114481331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d400c7cb0 0x7f8d401516a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8d3000ebd0 tx=0x7f8d30006df0).stop 2020-11-20T11:46:03.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d45a8c700 1 -- 172.21.15.105:0/3114481331 reap_dead start 2020-11-20T11:46:03.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 shutdown_connections 2020-11-20T11:46:03.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 >> 172.21.15.105:0/3114481331 conn(0x7f8d400bdca0 msgr2=0x7f8d400c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:03.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 shutdown_connections 2020-11-20T11:46:03.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.068+0000 7f8d1effd700 1 -- 172.21.15.105:0/3114481331 wait complete. 2020-11-20T11:46:03.585 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:03.585 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:03.585 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:03.586 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T11:46:03.771 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.768+0000 7f2bc1ab2700 1 Processor -- start 2020-11-20T11:46:03.772 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.768+0000 7f2bc1ab2700 1 -- start start 2020-11-20T11:46:03.773 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bc1ab2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2bbc0c25b0 0x7f2bbc067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bc1ab2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc062260 con 0x7f2bbc067380 2020-11-20T11:46:03.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bc1ab2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc062500 con 0x7f2bbc061d20 2020-11-20T11:46:03.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bc1ab2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc0627a0 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbbfff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2bbc061d20 0x7f2bbc0667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42154/0 (socket says 172.21.15.105:42154) 2020-11-20T11:46:03.774 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbbfff700 1 -- 172.21.15.105:0/4126476219 learned_addr learned my addr 172.21.15.105:0/4126476219 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:03.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbaffd700 1 --2- 172.21.15.105:0/4126476219 >> v2:172.21.15.100:3300/0 conn(0x7f2bbc0c25b0 0x7f2bbc067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbaffd700 1 -- 172.21.15.105:0/4126476219 >> v1:172.21.15.105:6789/0 conn(0x7f2bbc061d20 legacy=0x7f2bbc0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbaffd700 1 -- 172.21.15.105:0/4126476219 >> v1:172.21.15.100:6789/0 conn(0x7f2bbc067380 legacy=0x7f2bbc151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:03.775 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbaffd700 1 -- 172.21.15.105:0/4126476219 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc1513e0 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.769+0000 7f2bbaffd700 1 --2- 172.21.15.105:0/4126476219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc067760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2bb000b9a0 tx=0x7f2bb0006df0).ready entity=mon.1 client_cookie=568ef041aa449877 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bba7fc700 1 -- 172.21.15.105:0/4126476219 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0009800 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bba7fc700 1 -- 172.21.15.105:0/4126476219 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0009960 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.776 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bba7fc700 1 -- 172.21.15.105:0/4126476219 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0009ce0 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/4126476219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc0c25b0 msgr2=0x7f2bbc067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/4126476219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc067760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2bb000b9a0 tx=0x7f2bb0006df0).stop 2020-11-20T11:46:03.779 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/4126476219 shutdown_connections 2020-11-20T11:46:03.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/4126476219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc067760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.770+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/4126476219 >> 172.21.15.105:0/4126476219 conn(0x7f2bbc0bdd20 msgr2=0x7f2bbc0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:03.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.771+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/4126476219 shutdown_connections 2020-11-20T11:46:03.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.771+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/4126476219 wait complete. 2020-11-20T11:46:03.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.772+0000 7f2bc1ab2700 1 Processor -- start 2020-11-20T11:46:03.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.772+0000 7f2bc1ab2700 1 -- start start 2020-11-20T11:46:03.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 0x7f2bbc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.781 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c0e50 con 0x7f2bbc0c25b0 2020-11-20T11:46:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc154a00 con 0x7f2bbc067380 2020-11-20T11:46:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bc1ab2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c10c0 con 0x7f2bbc061d20 2020-11-20T11:46:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bbb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bbaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 0x7f2bbc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bbb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42552/0 (socket says 172.21.15.105:42552) 2020-11-20T11:46:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.773+0000 7f2bbb7fe700 1 -- 172.21.15.105:0/2072786023 learned_addr learned my addr 172.21.15.105:0/2072786023 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbbfff700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc1337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 -- 172.21.15.105:0/2072786023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 msgr2=0x7f2bbc154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 -- 172.21.15.105:0/2072786023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 msgr2=0x7f2bbc1337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc1337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 -- 172.21.15.105:0/2072786023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0c1360 con 0x7f2bbc067380 2020-11-20T11:46:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbbfff700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc1337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:46:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbb7fe700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:03.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bbaffd700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 0x7f2bbc1527b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f2bb0012000 tx=0x7f2bb0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb001e460 con 0x7f2bbc067380 2020-11-20T11:46:03.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb001e5c0 con 0x7f2bbc067380 2020-11-20T11:46:03.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb001e960 con 0x7f2bbc067380 2020-11-20T11:46:03.786 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc0c1600 con 0x7f2bbc067380 2020-11-20T11:46:03.786 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.774+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc154750 con 0x7f2bbc067380 2020-11-20T11:46:03.786 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.775+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc044f60 con 0x7f2bbc067380 2020-11-20T11:46:03.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.777+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2bb001a040 con 0x7f2bbc067380 2020-11-20T11:46:03.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.777+0000 7f2b9b7fe700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 0x7f2b94082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:03.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.777+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2bb00a3fb0 con 0x7f2bbc067380 2020-11-20T11:46:03.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.778+0000 7f2bbb7fe700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 0x7f2b94082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:03.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.779+0000 7f2bbb7fe700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 0x7f2b94082af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2bac002c00 tx=0x7f2bac007c30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:03.788 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:03.781+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2bb00789c0 con 0x7f2bbc067380 2020-11-20T11:46:04.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.013+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bbc0c1a60 con 0x7f2b94080630 2020-11-20T11:46:04.017 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.014+0000 7f2b9b7fe700 1 -- 172.21.15.105:0/2072786023 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2bbc0c1a60 con 0x7f2b94080630 2020-11-20T11:46:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 msgr2=0x7f2b94082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 0x7f2b94082af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2bac002c00 tx=0x7f2bac007c30).stop 2020-11-20T11:46:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 msgr2=0x7f2bbc1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 0x7f2bbc1527b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f2bb0012000 tx=0x7f2bb0015000).stop 2020-11-20T11:46:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 shutdown_connections 2020-11-20T11:46:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bbc0c25b0 0x7f2bbc1337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f2b94080630 0x7f2b94082af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bbc061d20 0x7f2bbc154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 --2- 172.21.15.105:0/2072786023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bbc067380 0x7f2bbc1527b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 >> 172.21.15.105:0/2072786023 conn(0x7f2bbc0bdd20 msgr2=0x7f2bbc0be100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 shutdown_connections 2020-11-20T11:46:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.017+0000 7f2bc1ab2700 1 -- 172.21.15.105:0/2072786023 wait complete. 2020-11-20T11:46:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T11:46:04.038 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T11:46:04.039 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:04.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 Processor -- start 2020-11-20T11:46:04.234 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 -- start start 2020-11-20T11:46:04.236 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f433014e600 0x7f433014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43300bca80 0x7f433009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300bcef0 con 0x7f43300c6230 2020-11-20T11:46:04.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4330067460 con 0x7f433014e600 2020-11-20T11:46:04.237 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.231+0000 7f43375ba700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4330067700 con 0x7f43300bca80 2020-11-20T11:46:04.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4334b55700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f43300c6230 0x7f433009b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42164/0 (socket says 172.21.15.105:42164) 2020-11-20T11:46:04.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4334b55700 1 -- 172.21.15.105:0/2724796018 learned_addr learned my addr 172.21.15.105:0/2724796018 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:04.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 --2- 172.21.15.105:0/2724796018 >> v2:172.21.15.67:3300/0 conn(0x7f433014e600 0x7f433014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335b57700 1 --2- 172.21.15.105:0/2724796018 >> v2:172.21.15.100:3300/0 conn(0x7f43300bca80 0x7f433009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.238 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f431ffff700 1 -- 172.21.15.105:0/2724796018 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493504076 0 0) 0x7f43300bcef0 con 0x7f43300c6230 2020-11-20T11:46:04.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f431ffff700 1 -- 172.21.15.105:0/2724796018 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4318003240 con 0x7f43300c6230 2020-11-20T11:46:04.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 -- 172.21.15.105:0/2724796018 >> v2:172.21.15.100:3300/0 conn(0x7f43300bca80 msgr2=0x7f433009bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 --2- 172.21.15.105:0/2724796018 >> v2:172.21.15.100:3300/0 conn(0x7f43300bca80 0x7f433009bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 -- 172.21.15.105:0/2724796018 >> v1:172.21.15.105:6789/0 conn(0x7f43300c6230 legacy=0x7f433009b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.239 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 -- 172.21.15.105:0/2724796018 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300679a0 con 0x7f433014e600 2020-11-20T11:46:04.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f4335356700 1 --2- 172.21.15.105:0/2724796018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f433014e600 0x7f433014e9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f43301522a0 tx=0x7f432c006d90).ready entity=mon.0 client_cookie=b39391f1ec59cb58 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f431ffff700 1 -- 172.21.15.105:0/2724796018 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c006030 con 0x7f433014e600 2020-11-20T11:46:04.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f431ffff700 1 -- 172.21.15.105:0/2724796018 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c006190 con 0x7f433014e600 2020-11-20T11:46:04.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.232+0000 7f431ffff700 1 -- 172.21.15.105:0/2724796018 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c006510 con 0x7f433014e600 2020-11-20T11:46:04.240 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 -- 172.21.15.105:0/2724796018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f433014e600 msgr2=0x7f433014e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 --2- 172.21.15.105:0/2724796018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f433014e600 0x7f433014e9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f43301522a0 tx=0x7f432c006d90).stop 2020-11-20T11:46:04.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 -- 172.21.15.105:0/2724796018 shutdown_connections 2020-11-20T11:46:04.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 --2- 172.21.15.105:0/2724796018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f433014e600 0x7f433014e9e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.241 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 --2- 172.21.15.105:0/2724796018 >> v2:172.21.15.100:3300/0 conn(0x7f43300bca80 0x7f433009bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.242 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.233+0000 7f43375ba700 1 -- 172.21.15.105:0/2724796018 >> 172.21.15.105:0/2724796018 conn(0x7f4330060bc0 msgr2=0x7f43300c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.234+0000 7f43375ba700 1 -- 172.21.15.105:0/2724796018 shutdown_connections 2020-11-20T11:46:04.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.234+0000 7f43375ba700 1 -- 172.21.15.105:0/2724796018 wait complete. 2020-11-20T11:46:04.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.235+0000 7f43375ba700 1 Processor -- start 2020-11-20T11:46:04.245 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.235+0000 7f43375ba700 1 -- start start 2020-11-20T11:46:04.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 0x7f43300c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43300c6230 0x7f4330155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f433014e600 0x7f4330155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330163f10 con 0x7f43300c6230 2020-11-20T11:46:04.246 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301641b0 con 0x7f433014e600 2020-11-20T11:46:04.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330164450 con 0x7f43300bca80 2020-11-20T11:46:04.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 0x7f43300c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 0x7f43300c00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42566/0 (socket says 172.21.15.105:42566) 2020-11-20T11:46:04.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 -- 172.21.15.105:0/1112738081 learned_addr learned my addr 172.21.15.105:0/1112738081 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:04.247 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335b57700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f433014e600 0x7f4330155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.248 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4334b55700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43300c6230 0x7f4330155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.248 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 -- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f433014e600 msgr2=0x7f4330155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.248 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f433014e600 0x7f4330155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.248 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 -- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43300c6230 msgr2=0x7f4330155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.248 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43300c6230 0x7f4330155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.249 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43301646f0 con 0x7f43300bca80 2020-11-20T11:46:04.249 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f4335356700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 0x7f43300c00d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f432c006b00 tx=0x7f432c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.249 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c009850 con 0x7f43300bca80 2020-11-20T11:46:04.249 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0099b0 con 0x7f43300bca80 2020-11-20T11:46:04.249 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433014eb60 con 0x7f43300bca80 2020-11-20T11:46:04.250 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.236+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c009d30 con 0x7f43300bca80 2020-11-20T11:46:04.250 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.237+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43300c05c0 con 0x7f43300bca80 2020-11-20T11:46:04.250 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.238+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f433014e9e0 con 0x7f43300bca80 2020-11-20T11:46:04.250 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.238+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f432c00f070 con 0x7f43300bca80 2020-11-20T11:46:04.250 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f431d7fa700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4308080630 0x7f4308082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.251 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f432c0a47a0 con 0x7f43300bca80 2020-11-20T11:46:04.251 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f4334b55700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4308080630 0x7f4308082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.251 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f431d7fa700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f43080892e0 0x7f430808b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.251 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f430808bd60 con 0x7f43080892e0 2020-11-20T11:46:04.252 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f432c0a6d80 con 0x7f43300bca80 2020-11-20T11:46:04.252 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.239+0000 7f4334b55700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4308080630 0x7f4308082af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f43300c4d90 tx=0x7f4320009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.252 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.240+0000 7f4335b57700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f43080892e0 0x7f430808b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.252 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.240+0000 7f4335b57700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f43080892e0 0x7f430808b700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.253 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.241+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== osd.5 v2:172.21.15.67:6808/25148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f430808bd60 con 0x7f43080892e0 2020-11-20T11:46:04.261 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.258+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 --> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4330163d00 con 0x7f43080892e0 2020-11-20T11:46:04.263 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.258+0000 7f431d7fa700 1 -- 172.21.15.105:0/1112738081 <== osd.5 v2:172.21.15.67:6808/25148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4330163d00 con 0x7f43080892e0 2020-11-20T11:46:04.263 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f43080892e0 msgr2=0x7f430808b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.263 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.67:6808/25148,v1:172.21.15.67:6809/25148] conn(0x7f43080892e0 0x7f430808b700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.263 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4308080630 msgr2=0x7f4308082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.264 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4308080630 0x7f4308082af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f43300c4d90 tx=0x7f4320009040).stop 2020-11-20T11:46:04.264 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 msgr2=0x7f43300c00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.264 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 --2- 172.21.15.105:0/1112738081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43300bca80 0x7f43300c00d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f432c006b00 tx=0x7f432c015000).stop 2020-11-20T11:46:04.264 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f4335b57700 1 -- 172.21.15.105:0/1112738081 reap_dead start 2020-11-20T11:46:04.264 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 shutdown_connections 2020-11-20T11:46:04.265 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 >> 172.21.15.105:0/1112738081 conn(0x7f4330060bc0 msgr2=0x7f43300c3610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.265 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 shutdown_connections 2020-11-20T11:46:04.265 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.259+0000 7f43375ba700 1 -- 172.21.15.105:0/1112738081 wait complete. 2020-11-20T11:46:04.265 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:04.266 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:04.266 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:04.274 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T11:46:04.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.447+0000 7fa2c5ef0700 1 Processor -- start 2020-11-20T11:46:04.452 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.448+0000 7fa2c5ef0700 1 -- start start 2020-11-20T11:46:04.453 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2c00c78e0 0x7fa2c00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa2c00669c0 0x7fa2c00c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 0x7fa2c0158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00c3f60 con 0x7fa2c00c21b0 2020-11-20T11:46:04.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c01593a0 con 0x7fa2c00c78e0 2020-11-20T11:46:04.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2c5ef0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c0159640 con 0x7fa2c00669c0 2020-11-20T11:46:04.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2beffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa2c00669c0 0x7fa2c00c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2beffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa2c00669c0 0x7fa2c00c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42576/0 (socket says 172.21.15.105:42576) 2020-11-20T11:46:04.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2beffd700 1 -- 172.21.15.105:0/3028987453 learned_addr learned my addr 172.21.15.105:0/3028987453 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:04.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2bf7fe700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.100:3300/0 conn(0x7fa2c00c78e0 0x7fa2c00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.449+0000 7fa2bffff700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 0x7fa2c0158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 -- 172.21.15.105:0/3028987453 >> v2:172.21.15.100:3300/0 conn(0x7fa2c00c78e0 msgr2=0x7fa2c00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.100:3300/0 conn(0x7fa2c00c78e0 0x7fa2c00c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 -- 172.21.15.105:0/3028987453 >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 msgr2=0x7fa2c0158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 0x7fa2c0158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 -- 172.21.15.105:0/3028987453 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c01598e0 con 0x7fa2c00669c0 2020-11-20T11:46:04.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2bffff700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 0x7fa2c0158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:04.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2beffd700 1 --2- 172.21.15.105:0/3028987453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00669c0 0x7fa2c00c3a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa2c0026ab0 tx=0x7fa2b0006eb0).ready entity=mon.2 client_cookie=e1619432150e25c6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2be7fc700 1 -- 172.21.15.105:0/3028987453 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00097b0 con 0x7fa2c00669c0 2020-11-20T11:46:04.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2be7fc700 1 -- 172.21.15.105:0/3028987453 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b0009910 con 0x7fa2c00669c0 2020-11-20T11:46:04.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.450+0000 7fa2be7fc700 1 -- 172.21.15.105:0/3028987453 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0009c90 con 0x7fa2c00669c0 2020-11-20T11:46:04.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/3028987453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00669c0 msgr2=0x7fa2c00c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/3028987453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00669c0 0x7fa2c00c3a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa2c0026ab0 tx=0x7fa2b0006eb0).stop 2020-11-20T11:46:04.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/3028987453 shutdown_connections 2020-11-20T11:46:04.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.67:3300/0 conn(0x7fa2c00c21b0 0x7fa2c0158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/3028987453 >> v2:172.21.15.100:3300/0 conn(0x7fa2c00c78e0 0x7fa2c00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/3028987453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00669c0 0x7fa2c00c3a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/3028987453 >> 172.21.15.105:0/3028987453 conn(0x7fa2c00bdd20 msgr2=0x7fa2c00be130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/3028987453 shutdown_connections 2020-11-20T11:46:04.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.451+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/3028987453 wait complete. 2020-11-20T11:46:04.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.452+0000 7fa2c5ef0700 1 Processor -- start 2020-11-20T11:46:04.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.452+0000 7fa2c5ef0700 1 -- start start 2020-11-20T11:46:04.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2c00c21b0 0x7fa2c0083970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0081e60 con 0x7fa2c00c21b0 2020-11-20T11:46:04.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0082100 con 0x7fa2c00669c0 2020-11-20T11:46:04.463 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2c5ef0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c015be50 con 0x7fa2c00c78e0 2020-11-20T11:46:04.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2bf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42582/0 (socket says 172.21.15.105:42582) 2020-11-20T11:46:04.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2bffff700 1 -- 172.21.15.105:0/2179047860 learned_addr learned my addr 172.21.15.105:0/2179047860 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:04.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2bf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60708/0 (socket says 172.21.15.105:60708) 2020-11-20T11:46:04.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.453+0000 7fa2beffd700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2c00c21b0 0x7fa2c0083970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 -- 172.21.15.105:0/2179047860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 msgr2=0x7fa2c0152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 -- 172.21.15.105:0/2179047860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2c00c21b0 msgr2=0x7fa2c0083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.465 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2c00c21b0 0x7fa2c0083970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 -- 172.21.15.105:0/2179047860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c015c0f0 con 0x7fa2c00669c0 2020-11-20T11:46:04.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bffff700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:46:04.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2bf7fe700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa2b400eba0 tx=0x7fa2b4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400c8b0 con 0x7fa2c00669c0 2020-11-20T11:46:04.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400ca10 con 0x7fa2c00669c0 2020-11-20T11:46:04.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400cd90 con 0x7fa2c00669c0 2020-11-20T11:46:04.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.454+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c015c390 con 0x7fa2c00669c0 2020-11-20T11:46:04.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.455+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c015c8d0 con 0x7fa2c00669c0 2020-11-20T11:46:04.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.456+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c0044f60 con 0x7fa2c00669c0 2020-11-20T11:46:04.468 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.457+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa2b4012600 con 0x7fa2c00669c0 2020-11-20T11:46:04.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.458+0000 7fa2a77fe700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 0x7fa294082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.458+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa2b40a37a0 con 0x7fa2c00669c0 2020-11-20T11:46:04.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.458+0000 7fa2beffd700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 0x7fa294082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.469 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.459+0000 7fa2beffd700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 0x7fa294082b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa2c0066e30 tx=0x7fa2b0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.470 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.461+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa2b4078170 con 0x7fa2c00669c0 2020-11-20T11:46:04.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.706+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2c00008d0 con 0x7fa294080660 2020-11-20T11:46:04.710 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.707+0000 7fa2a77fe700 1 -- 172.21.15.105:0/2179047860 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2c00008d0 con 0x7fa294080660 2020-11-20T11:46:04.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 msgr2=0x7fa294082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 0x7fa294082b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa2c0066e30 tx=0x7fa2b0015000).stop 2020-11-20T11:46:04.713 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 msgr2=0x7fa2c0081640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa2b400eba0 tx=0x7fa2b4006df0).stop 2020-11-20T11:46:04.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 shutdown_connections 2020-11-20T11:46:04.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa294080660 0x7fa294082b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.714 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2c00c78e0 0x7fa2c0152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2c00669c0 0x7fa2c0081640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 --2- 172.21.15.105:0/2179047860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2c00c21b0 0x7fa2c0083970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 >> 172.21.15.105:0/2179047860 conn(0x7fa2c00bdd20 msgr2=0x7fa2c0158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 shutdown_connections 2020-11-20T11:46:04.715 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.709+0000 7fa2c5ef0700 1 -- 172.21.15.105:0/2179047860 wait complete. 2020-11-20T11:46:04.716 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T11:46:04.724 INFO:tasks.ceph:Scrubbing osd.8 2020-11-20T11:46:04.725 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:04.893 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.890+0000 7fa66eadc700 1 Processor -- start 2020-11-20T11:46:04.894 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.890+0000 7fa66eadc700 1 -- start start 2020-11-20T11:46:04.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66eadc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa668061ee0 0x7fa668065060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66eadc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66809b1a0 con 0x7fa66809ad30 2020-11-20T11:46:04.897 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66eadc700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa668065640 con 0x7fa6680667b0 2020-11-20T11:46:04.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66eadc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66814d860 con 0x7fa668061ee0 2020-11-20T11:46:04.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66c878700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa668061ee0 0x7fa668065060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66d079700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6680667b0 0x7fa66814a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:32978/0 (socket says 172.21.15.105:32978) 2020-11-20T11:46:04.898 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa66d079700 1 -- 172.21.15.105:0/1178464713 learned_addr learned my addr 172.21.15.105:0/1178464713 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:04.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618948333 0 0) 0x7fa668065640 con 0x7fa6680667b0 2020-11-20T11:46:04.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c003240 con 0x7fa6680667b0 2020-11-20T11:46:04.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812624505 0 0) 0x7fa66809b1a0 con 0x7fa66809ad30 2020-11-20T11:46:04.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa668065640 con 0x7fa66809ad30 2020-11-20T11:46:04.899 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1989628099 0 0) 0x7fa64c003240 con 0x7fa6680667b0 2020-11-20T11:46:04.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 >> v2:172.21.15.67:3300/0 conn(0x7fa668061ee0 msgr2=0x7fa668065060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 --2- 172.21.15.105:0/1178464713 >> v2:172.21.15.67:3300/0 conn(0x7fa668061ee0 0x7fa668065060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 >> v1:172.21.15.67:6789/0 conn(0x7fa66809ad30 legacy=0x7fa6680622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66814db00 con 0x7fa6680667b0 2020-11-20T11:46:04.900 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7fa660001860 con 0x7fa6680667b0 2020-11-20T11:46:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.891+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 >> v1:172.21.15.100:6789/0 conn(0x7fa6680667b0 legacy=0x7fa66814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 0x7fa64c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa64c0044e0 0x7fa64c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c004e50 0x7fa64c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66814d860 con 0x7fa64c0044e0 2020-11-20T11:46:04.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c00bc20 con 0x7fa64c004e50 2020-11-20T11:46:04.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c00bd60 con 0x7fa64c003910 2020-11-20T11:46:04.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 0x7fa64c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.902 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66d079700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c004e50 0x7fa64c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa667fff700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa64c0044e0 0x7fa64c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 -- 172.21.15.105:0/1178464713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c004e50 msgr2=0x7fa64c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c004e50 0x7fa64c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 -- 172.21.15.105:0/1178464713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa64c0044e0 msgr2=0x7fa64c004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:04.903 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa64c0044e0 0x7fa64c004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 -- 172.21.15.105:0/1178464713 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c003240 con 0x7fa64c003910 2020-11-20T11:46:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66d079700 1 -- 172.21.15.105:0/1178464713 reap_dead start 2020-11-20T11:46:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa66c878700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 0x7fa64c003d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa65c00bc00 tx=0x7fa65c006df0).ready entity=mon.2 client_cookie=d68bdc7816428f3f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00b310 con 0x7fa64c003910 2020-11-20T11:46:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00ea90 con 0x7fa64c003910 2020-11-20T11:46:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.892+0000 7fa6677fe700 1 -- 172.21.15.105:0/1178464713 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ee10 con 0x7fa64c003910 2020-11-20T11:46:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 -- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 msgr2=0x7fa64c003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 0x7fa64c003d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa65c00bc00 tx=0x7fa65c006df0).stop 2020-11-20T11:46:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 -- 172.21.15.105:0/1178464713 shutdown_connections 2020-11-20T11:46:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 --2- 172.21.15.105:0/1178464713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa64c003910 0x7fa64c003d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 -- 172.21.15.105:0/1178464713 >> 172.21.15.105:0/1178464713 conn(0x7fa6680b9890 msgr2=0x7fa6680b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 -- 172.21.15.105:0/1178464713 shutdown_connections 2020-11-20T11:46:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.893+0000 7fa66eadc700 1 -- 172.21.15.105:0/1178464713 wait complete. 2020-11-20T11:46:04.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.895+0000 7fa66eadc700 1 Processor -- start 2020-11-20T11:46:04.908 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.895+0000 7fa66eadc700 1 -- start start 2020-11-20T11:46:04.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 0x7fa668132d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66814ab60 0x7fa668141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa66814afe0 0x7fa66813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.909 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66814b710 con 0x7fa66814ab60 2020-11-20T11:46:04.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66813bed0 con 0x7fa64c003910 2020-11-20T11:46:04.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66eadc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66813c170 con 0x7fa66814afe0 2020-11-20T11:46:04.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa667fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66814ab60 0x7fa668141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 0x7fa668132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.910 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 0x7fa668132d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60728/0 (socket says 172.21.15.105:60728) 2020-11-20T11:46:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa667fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66814ab60 0x7fa668141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45898/0 (socket says 172.21.15.105:45898) 2020-11-20T11:46:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 -- 172.21.15.105:0/3872695139 learned_addr learned my addr 172.21.15.105:0/3872695139 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66d079700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa66814afe0 0x7fa66813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 -- 172.21.15.105:0/3872695139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa66814afe0 msgr2=0x7fa66813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa66814afe0 0x7fa66813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 -- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66814ab60 msgr2=0x7fa668141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66814ab60 0x7fa668141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66813c410 con 0x7fa64c003910 2020-11-20T11:46:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.896+0000 7fa66c878700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 0x7fa668132d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa65c006d00 tx=0x7fa65c019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.897+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c012d70 con 0x7fa64c003910 2020-11-20T11:46:04.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.897+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c01d410 con 0x7fa64c003910 2020-11-20T11:46:04.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.897+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66813c6b0 con 0x7fa64c003910 2020-11-20T11:46:04.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.897+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa668133210 con 0x7fa64c003910 2020-11-20T11:46:04.913 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.897+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c01d5c0 con 0x7fa64c003910 2020-11-20T11:46:04.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.898+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa668044f60 con 0x7fa64c003910 2020-11-20T11:46:04.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.899+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa65c02d070 con 0x7fa64c003910 2020-11-20T11:46:04.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.899+0000 7fa664ff9700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa640080630 0x7fa640082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.899+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa65c0a4780 con 0x7fa64c003910 2020-11-20T11:46:04.914 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa667fff700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa640080630 0x7fa640082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa664ff9700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fa640089360 0x7fa64008b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:04.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa64008bde0 con 0x7fa640089360 2020-11-20T11:46:04.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa65c0a6d60 con 0x7fa64c003910 2020-11-20T11:46:04.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa667fff700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa640080630 0x7fa640082af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa6680c42d0 tx=0x7fa654007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.915 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.900+0000 7fa66d079700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fa640089360 0x7fa64008b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:04.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.901+0000 7fa66d079700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fa640089360 0x7fa64008b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:04.916 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.902+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== osd.8 v2:172.21.15.67:6816/25152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa64008bde0 con 0x7fa640089360 2020-11-20T11:46:04.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.932+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 --> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6680c0d30 con 0x7fa640089360 2020-11-20T11:46:04.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.933+0000 7fa664ff9700 1 -- 172.21.15.105:0/3872695139 <== osd.8 v2:172.21.15.67:6816/25152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa6680c0d30 con 0x7fa640089360 2020-11-20T11:46:04.937 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:04.937 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:04.937 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:04.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.934+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fa640089360 msgr2=0x7fa64008b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.934+0000 7fa66eadc700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.67:6816/25152,v1:172.21.15.67:6817/25152] conn(0x7fa640089360 0x7fa64008b780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:04.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa640080630 msgr2=0x7fa640082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fa640080630 0x7fa640082af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa6680c42d0 tx=0x7fa654007b90).stop 2020-11-20T11:46:04.939 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 msgr2=0x7fa668132d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:04.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 --2- 172.21.15.105:0/3872695139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa64c003910 0x7fa668132d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa65c006d00 tx=0x7fa65c019000).stop 2020-11-20T11:46:04.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66d079700 1 -- 172.21.15.105:0/3872695139 reap_dead start 2020-11-20T11:46:04.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 shutdown_connections 2020-11-20T11:46:04.940 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 >> 172.21.15.105:0/3872695139 conn(0x7fa6680b9890 msgr2=0x7fa6680bbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:04.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 shutdown_connections 2020-11-20T11:46:04.941 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:04.935+0000 7fa66eadc700 1 -- 172.21.15.105:0/3872695139 wait complete. 2020-11-20T11:46:04.953 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2020-11-20T11:46:05.133 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.127+0000 7f54d58c1700 1 Processor -- start 2020-11-20T11:46:05.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.127+0000 7f54d58c1700 1 -- start start 2020-11-20T11:46:05.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54d58c1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 0x7f54d0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54d58c1700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f54d00624b0 0x7f54d00628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54d58c1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d0158d50 con 0x7f54d009b840 2020-11-20T11:46:05.134 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54d58c1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d0158ff0 con 0x7f54d009bc20 2020-11-20T11:46:05.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54d58c1700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d0159290 con 0x7f54d00624b0 2020-11-20T11:46:05.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54ceffd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f54d009b840 0x7f54d0152570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:32998/0 (socket says 172.21.15.105:32998) 2020-11-20T11:46:05.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54ceffd700 1 -- 172.21.15.105:0/742387613 learned_addr learned my addr 172.21.15.105:0/742387613 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:05.135 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.128+0000 7f54ce7fc700 1 --2- 172.21.15.105:0/742387613 >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 0x7f54d0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.136 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.132+0000 7f54cf7fe700 1 --2- 172.21.15.105:0/742387613 >> v2:172.21.15.100:3300/0 conn(0x7f54d00624b0 0x7f54d00628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.137 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.133+0000 7f54cf7fe700 1 -- 172.21.15.105:0/742387613 >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 msgr2=0x7f54d0152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:05.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.136+0000 7f54cf7fe700 1 --2- 172.21.15.105:0/742387613 >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 0x7f54d0152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.136+0000 7f54cf7fe700 1 -- 172.21.15.105:0/742387613 >> v1:172.21.15.100:6789/0 conn(0x7f54d009b840 legacy=0x7f54d0152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.136+0000 7f54cf7fe700 1 -- 172.21.15.105:0/742387613 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0159530 con 0x7f54d00624b0 2020-11-20T11:46:05.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.136+0000 7f54cf7fe700 1 --2- 172.21.15.105:0/742387613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d00628e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f54d0067df0 tx=0x7f54c4006df0).ready entity=mon.1 client_cookie=6c43e74b0afdf3fa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.140 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.136+0000 7f54ce7fc700 1 --2- 172.21.15.105:0/742387613 >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 0x7f54d0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:46:05.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.137+0000 7f54cdffb700 1 -- 172.21.15.105:0/742387613 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4009840 con 0x7f54d00624b0 2020-11-20T11:46:05.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.138+0000 7f54cdffb700 1 -- 172.21.15.105:0/742387613 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40099a0 con 0x7f54d00624b0 2020-11-20T11:46:05.142 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.138+0000 7f54cdffb700 1 -- 172.21.15.105:0/742387613 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4009d20 con 0x7f54d00624b0 2020-11-20T11:46:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.139+0000 7f54d58c1700 1 -- 172.21.15.105:0/742387613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 msgr2=0x7f54d00628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.139+0000 7f54d58c1700 1 --2- 172.21.15.105:0/742387613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d00628e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f54d0067df0 tx=0x7f54c4006df0).stop 2020-11-20T11:46:05.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 -- 172.21.15.105:0/742387613 shutdown_connections 2020-11-20T11:46:05.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 --2- 172.21.15.105:0/742387613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d00628e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 --2- 172.21.15.105:0/742387613 >> v2:172.21.15.67:3300/0 conn(0x7f54d009bc20 0x7f54d0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.146 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 -- 172.21.15.105:0/742387613 >> 172.21.15.105:0/742387613 conn(0x7f54d00b9910 msgr2=0x7f54d00b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 -- 172.21.15.105:0/742387613 shutdown_connections 2020-11-20T11:46:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.142+0000 7f54d58c1700 1 -- 172.21.15.105:0/742387613 wait complete. 2020-11-20T11:46:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.144+0000 7f54d58c1700 1 Processor -- start 2020-11-20T11:46:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.145+0000 7f54d58c1700 1 -- start start 2020-11-20T11:46:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d009b840 0x7f54d0165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 0x7f54d015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0149a80 con 0x7f54d009b840 2020-11-20T11:46:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00c1540 con 0x7f54d00624b0 2020-11-20T11:46:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54d58c1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00c17e0 con 0x7f54d009bc20 2020-11-20T11:46:05.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54cf7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 0x7f54d015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54cf7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 0x7f54d015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42620/0 (socket says 172.21.15.105:42620) 2020-11-20T11:46:05.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54cf7fe700 1 -- 172.21.15.105:0/435527076 learned_addr learned my addr 172.21.15.105:0/435527076 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:05.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ce7fc700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d009b840 0x7f54d0165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.152 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 -- 172.21.15.105:0/435527076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 msgr2=0x7f54d015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 0x7f54d015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 -- 172.21.15.105:0/435527076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d009b840 msgr2=0x7f54d0165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.153 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d009b840 0x7f54d0165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.146+0000 7f54ceffd700 1 -- 172.21.15.105:0/435527076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00c1a80 con 0x7f54d00624b0 2020-11-20T11:46:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54ceffd700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d015b4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f54c800ca90 tx=0x7f54c8007ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8005b80 con 0x7f54d00624b0 2020-11-20T11:46:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c8005ce0 con 0x7f54d00624b0 2020-11-20T11:46:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8007340 con 0x7f54d00624b0 2020-11-20T11:46:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d00c1d20 con 0x7f54d00624b0 2020-11-20T11:46:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.147+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d0164990 con 0x7f54d00624b0 2020-11-20T11:46:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.148+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00c3f40 con 0x7f54d00624b0 2020-11-20T11:46:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.151+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f54c8010030 con 0x7f54d00624b0 2020-11-20T11:46:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.152+0000 7f54b6ffd700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 0x7f54ac082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.152+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f54c80a2ff0 con 0x7f54d00624b0 2020-11-20T11:46:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.153+0000 7f54ce7fc700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 0x7f54ac082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.156+0000 7f54ce7fc700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 0x7f54ac082af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f54c0006bd0 tx=0x7f54c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.163+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f54c8077980 con 0x7f54d00624b0 2020-11-20T11:46:05.431 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.428+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d0159710 con 0x7f54ac080630 2020-11-20T11:46:05.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.428+0000 7f54b6ffd700 1 -- 172.21.15.105:0/435527076 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54d0159710 con 0x7f54ac080630 2020-11-20T11:46:05.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.433+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 msgr2=0x7f54ac082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.433+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 0x7f54ac082af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f54c0006bd0 tx=0x7f54c0008040).stop 2020-11-20T11:46:05.438 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.433+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 msgr2=0x7f54d015b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.433+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d015b4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f54c800ca90 tx=0x7f54c8007ed0).stop 2020-11-20T11:46:05.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 shutdown_connections 2020-11-20T11:46:05.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f54ac080630 0x7f54ac082af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54d009bc20 0x7f54d015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.439 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00624b0 0x7f54d015b4f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.440 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 --2- 172.21.15.105:0/435527076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d009b840 0x7f54d0165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.440 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.434+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 >> 172.21.15.105:0/435527076 conn(0x7f54d00b9910 msgr2=0x7f54d00629a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:05.440 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.435+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 shutdown_connections 2020-11-20T11:46:05.441 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.435+0000 7f54d58c1700 1 -- 172.21.15.105:0/435527076 wait complete. 2020-11-20T11:46:05.441 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 8 to deep-scrub 2020-11-20T11:46:05.455 INFO:tasks.ceph:Scrubbing osd.11 2020-11-20T11:46:05.455 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:46:05.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.614+0000 7f1f0c6fe700 1 Processor -- start 2020-11-20T11:46:05.618 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.614+0000 7f1f0c6fe700 1 -- start start 2020-11-20T11:46:05.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.615+0000 7f1f0c6fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f040c38a0 0x7f1f040626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.615+0000 7f1f0c6fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f041554d0 0x7f1f04155960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.621 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.615+0000 7f1f0c6fe700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040bf2e0 con 0x7f1f040c34c0 2020-11-20T11:46:05.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.615+0000 7f1f0c6fe700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f04062be0 con 0x7f1f040c38a0 2020-11-20T11:46:05.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.615+0000 7f1f0c6fe700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0409b1c0 con 0x7f1f041554d0 2020-11-20T11:46:05.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09c99700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f040c38a0 0x7f1f040626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f041554d0 0x7f1f04155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.622 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0a49a700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1f040c34c0 0x7f1f040bebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.105:53690/0 (socket says 172.21.15.105:53690) 2020-11-20T11:46:05.623 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0a49a700 1 -- 172.21.15.105:0/3259815177 learned_addr learned my addr 172.21.15.105:0/3259815177 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:05.623 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09498700 1 -- 172.21.15.105:0/3259815177 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916517508 0 0) 0x7f1f040bf2e0 con 0x7f1f040c34c0 2020-11-20T11:46:05.623 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09498700 1 -- 172.21.15.105:0/3259815177 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eec003240 con 0x7f1f040c34c0 2020-11-20T11:46:05.623 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 -- 172.21.15.105:0/3259815177 >> v2:172.21.15.67:3300/0 conn(0x7f1f040c38a0 msgr2=0x7f1f040626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:05.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 --2- 172.21.15.105:0/3259815177 >> v2:172.21.15.67:3300/0 conn(0x7f1f040c38a0 0x7f1f040626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 -- 172.21.15.105:0/3259815177 >> v1:172.21.15.67:6789/0 conn(0x7f1f040c34c0 legacy=0x7f1f040bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.624 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 -- 172.21.15.105:0/3259815177 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04158c60 con 0x7f1f041554d0 2020-11-20T11:46:05.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f0ac9b700 1 --2- 172.21.15.105:0/3259815177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f04155960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1efc009c90 tx=0x7f1efc0091d0).ready entity=mon.1 client_cookie=6282bcd5606d839 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09498700 1 -- 172.21.15.105:0/3259815177 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00b980 con 0x7f1f041554d0 2020-11-20T11:46:05.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09498700 1 -- 172.21.15.105:0/3259815177 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00bae0 con 0x7f1f041554d0 2020-11-20T11:46:05.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.616+0000 7f1f09498700 1 -- 172.21.15.105:0/3259815177 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00be60 con 0x7f1f041554d0 2020-11-20T11:46:05.625 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/3259815177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 msgr2=0x7f1f04155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/3259815177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f04155960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1efc009c90 tx=0x7f1efc0091d0).stop 2020-11-20T11:46:05.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/3259815177 shutdown_connections 2020-11-20T11:46:05.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/3259815177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f04155960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/3259815177 >> v2:172.21.15.67:3300/0 conn(0x7f1f040c38a0 0x7f1f040626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.626 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/3259815177 >> 172.21.15.105:0/3259815177 conn(0x7f1f040b9890 msgr2=0x7f1f040b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:05.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/3259815177 shutdown_connections 2020-11-20T11:46:05.627 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.617+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/3259815177 wait complete. 2020-11-20T11:46:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.618+0000 7f1f0c6fe700 1 Processor -- start 2020-11-20T11:46:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.618+0000 7f1f0c6fe700 1 -- start start 2020-11-20T11:46:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 0x7f1f04151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f040c38a0 0x7f1f040bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f040bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04167e70 con 0x7f1f040c34c0 2020-11-20T11:46:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04168110 con 0x7f1f041554d0 2020-11-20T11:46:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0c6fe700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f041683b0 con 0x7f1f040c38a0 2020-11-20T11:46:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f09c99700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f040c38a0 0x7f1f040bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0a49a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 0x7f1f04151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0ac9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f040bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0a49a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 0x7f1f04151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45926/0 (socket says 172.21.15.105:45926) 2020-11-20T11:46:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f09c99700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f040c38a0 0x7f1f040bb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42632/0 (socket says 172.21.15.105:42632) 2020-11-20T11:46:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.619+0000 7f1f0a49a700 1 -- 172.21.15.105:0/1817905687 learned_addr learned my addr 172.21.15.105:0/1817905687 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 -- 172.21.15.105:0/1817905687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f040c38a0 msgr2=0x7f1f040bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f040c38a0 0x7f1f040bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 -- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 msgr2=0x7f1f040bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f041554d0 0x7f1f040bc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 -- 172.21.15.105:0/1817905687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04168650 con 0x7f1f040c34c0 2020-11-20T11:46:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0a49a700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 0x7f1f04151b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1ef400c6e0 tx=0x7f1ef4007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40072e0 con 0x7f1f040c34c0 2020-11-20T11:46:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4007440 con 0x7f1f040c34c0 2020-11-20T11:46:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4005820 con 0x7f1f040c34c0 2020-11-20T11:46:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f041688f0 con 0x7f1f040c34c0 2020-11-20T11:46:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.620+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f04156ae0 con 0x7f1f040c34c0 2020-11-20T11:46:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.622+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1ef4010070 con 0x7f1f040c34c0 2020-11-20T11:46:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1ef27fc700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1edc080630 0x7f1edc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.636 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1ef40a1ff0 con 0x7f1f040c34c0 2020-11-20T11:46:05.636 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f09c99700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1edc080630 0x7f1edc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.636 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f1f04151ff0 0x7f1f040bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.636 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 --> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f0405c870 con 0x7f1f04151ff0 2020-11-20T11:46:05.636 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f0ac9b700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f1f04151ff0 0x7f1f040bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.637 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f09c99700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1edc080630 0x7f1edc082af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1f04152470 tx=0x7f1f00006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.637 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.623+0000 7f1f0ac9b700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f1f04151ff0 0x7f1f040bcb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.637 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.624+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== osd.11 v2:172.21.15.67:6800/25149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f1f0405c870 con 0x7f1f04151ff0 2020-11-20T11:46:05.646 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.642+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 --> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1f04168d50 con 0x7f1f04151ff0 2020-11-20T11:46:05.647 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1ef27fc700 1 -- 172.21.15.105:0/1817905687 <== osd.11 v2:172.21.15.67:6800/25149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1f04168d50 con 0x7f1f04151ff0 2020-11-20T11:46:05.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f1f04151ff0 msgr2=0x7f1f040bcb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:6800/25149,v1:172.21.15.67:6801/25149] conn(0x7f1f04151ff0 0x7f1f040bcb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1edc080630 msgr2=0x7f1edc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f1edc080630 0x7f1edc082af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1f04152470 tx=0x7f1f00006df0).stop 2020-11-20T11:46:05.648 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 msgr2=0x7f1f04151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.649 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 --2- 172.21.15.105:0/1817905687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f040c34c0 0x7f1f04151b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1ef400c6e0 tx=0x7f1ef4007ac0).stop 2020-11-20T11:46:05.649 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0ac9b700 1 -- 172.21.15.105:0/1817905687 reap_dead start 2020-11-20T11:46:05.649 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 shutdown_connections 2020-11-20T11:46:05.649 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 >> 172.21.15.105:0/1817905687 conn(0x7f1f040b9890 msgr2=0x7f1f040654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:05.650 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 shutdown_connections 2020-11-20T11:46:05.650 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.643+0000 7f1f0c6fe700 1 -- 172.21.15.105:0/1817905687 wait complete. 2020-11-20T11:46:05.650 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-11-20T11:46:05.650 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:46:05.650 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-11-20T11:46:05.658 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2020-11-20T11:46:05.819 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.816+0000 7f785f0ef700 1 Processor -- start 2020-11-20T11:46:05.820 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.816+0000 7f785f0ef700 1 -- start start 2020-11-20T11:46:05.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785f0ef700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78581518e0 0x7f78580c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785f0ef700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f785814dbc0 0x7f785814e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.821 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785f0ef700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858061d20 con 0x7f78580bfd60 2020-11-20T11:46:05.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785f0ef700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580be1c0 con 0x7f78581518e0 2020-11-20T11:46:05.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785f0ef700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580be460 con 0x7f785814dbc0 2020-11-20T11:46:05.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f7857fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78581518e0 0x7f78580c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.822 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f7857fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78581518e0 0x7f78580c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45938/0 (socket says 172.21.15.105:45938) 2020-11-20T11:46:05.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f785ce8b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f78580bfd60 0x7f7858067430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:33028/0 (socket says 172.21.15.105:33028) 2020-11-20T11:46:05.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.817+0000 7f7857fff700 1 -- 172.21.15.105:0/2131955687 learned_addr learned my addr 172.21.15.105:0/2131955687 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:05.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422175728 0 0) 0x7f7858061d20 con 0x7f78580bfd60 2020-11-20T11:46:05.823 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7844003240 con 0x7f78580bfd60 2020-11-20T11:46:05.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3410156346 0 0) 0x7f7844003240 con 0x7f78580bfd60 2020-11-20T11:46:05.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 >> v2:172.21.15.105:3300/0 conn(0x7f785814dbc0 msgr2=0x7f785814e010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:46:05.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 --2- 172.21.15.105:0/2131955687 >> v2:172.21.15.105:3300/0 conn(0x7f785814dbc0 0x7f785814e010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:05.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 >> v2:172.21.15.67:3300/0 conn(0x7f78581518e0 msgr2=0x7f78580c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:05.825 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 --2- 172.21.15.105:0/2131955687 >> v2:172.21.15.67:3300/0 conn(0x7f78581518e0 0x7f78580c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785814d790 con 0x7f78580bfd60 2020-11-20T11:46:05.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 701489643 0 0) 0x7f7850001860 con 0x7f78580bfd60 2020-11-20T11:46:05.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 >> v1:172.21.15.100:6789/0 conn(0x7f78580bfd60 legacy=0x7f7858067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.826 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7844003850 0x7f7844003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78440044e0 0x7f7844004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7844004e50 0x7f784400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580be1c0 con 0x7f7844004e50 2020-11-20T11:46:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580be460 con 0x7f7844003850 2020-11-20T11:46:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784400bc20 con 0x7f78440044e0 2020-11-20T11:46:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.818+0000 7f7857fff700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78440044e0 0x7f7844004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f785ce8b700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7844003850 0x7f7844003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 -- 172.21.15.105:0/2131955687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7844003850 msgr2=0x7f7844003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7844003850 0x7f7844003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 -- 172.21.15.105:0/2131955687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7844004e50 msgr2=0x7f784400b730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:46:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7844004e50 0x7f784400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 -- 172.21.15.105:0/2131955687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844003240 con 0x7f78440044e0 2020-11-20T11:46:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f7857fff700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78440044e0 0x7f7844004960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7858151ce0 tx=0x7f784c008040).ready entity=mon.2 client_cookie=acc944056fff3884 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00d8f0 con 0x7f78440044e0 2020-11-20T11:46:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00da50 con 0x7f78440044e0 2020-11-20T11:46:05.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.819+0000 7f78577fe700 1 -- 172.21.15.105:0/2131955687 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00ddd0 con 0x7f78440044e0 2020-11-20T11:46:05.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.820+0000 7f785f0ef700 1 -- 172.21.15.105:0/2131955687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78440044e0 msgr2=0x7f7844004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:05.830 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.820+0000 7f785f0ef700 1 --2- 172.21.15.105:0/2131955687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78440044e0 0x7f7844004960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7858151ce0 tx=0x7f784c008040).stop 2020-11-20T11:46:05.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.823+0000 7f785d68c700 1 -- 172.21.15.105:0/2131955687 reap_dead start 2020-11-20T11:46:05.831 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.823+0000 7f785d68c700 1 -- 172.21.15.105:0/2131955687 reap_dead start 2020-11-20T11:46:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.824+0000 7f785f0ef700 1 -- 172.21.15.105:0/2131955687 shutdown_connections 2020-11-20T11:46:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.824+0000 7f785f0ef700 1 -- 172.21.15.105:0/2131955687 >> 172.21.15.105:0/2131955687 conn(0x7f78580b9910 msgr2=0x7f78580b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.824+0000 7f785f0ef700 1 -- 172.21.15.105:0/2131955687 shutdown_connections 2020-11-20T11:46:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.824+0000 7f785f0ef700 1 -- 172.21.15.105:0/2131955687 wait complete. 2020-11-20T11:46:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.827+0000 7f785f0ef700 1 Processor -- start 2020-11-20T11:46:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.827+0000 7f785f0ef700 1 -- start start 2020-11-20T11:46:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7858163c40 0x7f785814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7858156b40 0x7f78580bae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858164500 con 0x7f78440044e0 2020-11-20T11:46:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581647a0 con 0x7f7858163c40 2020-11-20T11:46:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785f0ef700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858164a40 con 0x7f7858156b40 2020-11-20T11:46:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.105:45946/0 (socket says 172.21.15.105:45946) 2020-11-20T11:46:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 -- 172.21.15.105:0/969696046 learned_addr learned my addr 172.21.15.105:0/969696046 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:05.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 -- 172.21.15.105:0/969696046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7858156b40 msgr2=0x7f78580bae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T11:46:05.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7858156b40 0x7f78580bae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:05.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 -- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7858163c40 msgr2=0x7f785814f460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2020-11-20T11:46:05.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7858163c40 0x7f785814f460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:05.836 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.828+0000 7f785ce8b700 1 -- 172.21.15.105:0/969696046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785814ea80 con 0x7f78440044e0 2020-11-20T11:46:05.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.829+0000 7f785ce8b700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7850007710 tx=0x7f7850007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.829+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000fdc0 con 0x7f78440044e0 2020-11-20T11:46:05.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.829+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850012350 con 0x7f78440044e0 2020-11-20T11:46:05.837 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.829+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500126d0 con 0x7f78440044e0 2020-11-20T11:46:05.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.830+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785814ed20 con 0x7f78440044e0 2020-11-20T11:46:05.838 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.830+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785814f950 con 0x7f78440044e0 2020-11-20T11:46:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.837+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f785001b030 con 0x7f78440044e0 2020-11-20T11:46:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.837+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785814f180 con 0x7f78440044e0 2020-11-20T11:46:05.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.837+0000 7f7854ff9700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 0x7f7830082b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:05.841 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.837+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f78500a26b0 con 0x7f78440044e0 2020-11-20T11:46:05.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.838+0000 7f7857fff700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 0x7f7830082b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:05.842 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.838+0000 7f7857fff700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 0x7f7830082b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f784c00b210 tx=0x7f784c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:05.848 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:05.845+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7850045fd0 con 0x7f78440044e0 2020-11-20T11:46:06.116 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.113+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7f7858044f60 con 0x7f78300806b0 2020-11-20T11:46:06.117 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.113+0000 7f7854ff9700 1 -- 172.21.15.105:0/969696046 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f7858044f60 con 0x7f78300806b0 2020-11-20T11:46:06.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 msgr2=0x7f7830082b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.121 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 0x7f7830082b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f784c00b210 tx=0x7f784c008040).stop 2020-11-20T11:46:06.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 msgr2=0x7f7858150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7850007710 tx=0x7f7850007a10).stop 2020-11-20T11:46:06.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 shutdown_connections 2020-11-20T11:46:06.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f78300806b0 0x7f7830082b70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.122 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7858156b40 0x7f78580bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:06.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78440044e0 0x7f7858150330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 --2- 172.21.15.105:0/969696046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7858163c40 0x7f785814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:06.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 >> 172.21.15.105:0/969696046 conn(0x7f78580b9910 msgr2=0x7f78580c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:06.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 shutdown_connections 2020-11-20T11:46:06.123 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.117+0000 7f785f0ef700 1 -- 172.21.15.105:0/969696046 wait complete. 2020-11-20T11:46:06.124 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 11 to deep-scrub 2020-11-20T11:46:06.140 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:46:06.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.306+0000 7f4b02f47700 1 Processor -- start 2020-11-20T11:46:06.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.307+0000 7f4b02f47700 1 -- start start 2020-11-20T11:46:06.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b02f47700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4afc09d310 0x7f4afc150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:06.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b02f47700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc064160 con 0x7f4afc155eb0 2020-11-20T11:46:06.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b02f47700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc064400 con 0x7f4afc09cf30 2020-11-20T11:46:06.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b02f47700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc0646a0 con 0x7f4afc09d310 2020-11-20T11:46:06.312 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b00ce3700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4afc09cf30 0x7f4afc1507a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42258/0 (socket says 172.21.15.105:42258) 2020-11-20T11:46:06.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4b00ce3700 1 -- 172.21.15.105:0/2725608084 learned_addr learned my addr 172.21.15.105:0/2725608084 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:06.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4afbfff700 1 --2- 172.21.15.105:0/2725608084 >> v2:172.21.15.67:3300/0 conn(0x7f4afc09d310 0x7f4afc150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:06.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4afb7fe700 1 -- 172.21.15.105:0/2725608084 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36972221 0 0) 0x7f4afc064400 con 0x7f4afc09cf30 2020-11-20T11:46:06.313 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.308+0000 7f4afb7fe700 1 -- 172.21.15.105:0/2725608084 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae0003240 con 0x7f4afc09cf30 2020-11-20T11:46:06.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afbfff700 1 -- 172.21.15.105:0/2725608084 >> v1:172.21.15.105:6789/0 conn(0x7f4afc09cf30 legacy=0x7f4afc1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afbfff700 1 -- 172.21.15.105:0/2725608084 >> v1:172.21.15.67:6789/0 conn(0x7f4afc155eb0 legacy=0x7f4afc1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afbfff700 1 -- 172.21.15.105:0/2725608084 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc064940 con 0x7f4afc09d310 2020-11-20T11:46:06.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afbfff700 1 --2- 172.21.15.105:0/2725608084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09d310 0x7f4afc150eb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4ae800b9a0 tx=0x7f4ae8006df0).ready entity=mon.0 client_cookie=f7dbf00cb16ddb23 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:06.315 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afb7fe700 1 -- 172.21.15.105:0/2725608084 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80096b0 con 0x7f4afc09d310 2020-11-20T11:46:06.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afb7fe700 1 -- 172.21.15.105:0/2725608084 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8009810 con 0x7f4afc09d310 2020-11-20T11:46:06.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.309+0000 7f4afb7fe700 1 -- 172.21.15.105:0/2725608084 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8009b90 con 0x7f4afc09d310 2020-11-20T11:46:06.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 -- 172.21.15.105:0/2725608084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09d310 msgr2=0x7f4afc150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 --2- 172.21.15.105:0/2725608084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09d310 0x7f4afc150eb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4ae800b9a0 tx=0x7f4ae8006df0).stop 2020-11-20T11:46:06.316 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 -- 172.21.15.105:0/2725608084 shutdown_connections 2020-11-20T11:46:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 --2- 172.21.15.105:0/2725608084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09d310 0x7f4afc150eb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 -- 172.21.15.105:0/2725608084 >> 172.21.15.105:0/2725608084 conn(0x7f4afc060130 msgr2=0x7f4afc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 -- 172.21.15.105:0/2725608084 shutdown_connections 2020-11-20T11:46:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.310+0000 7f4b02f47700 1 -- 172.21.15.105:0/2725608084 wait complete. 2020-11-20T11:46:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.312+0000 7f4b02f47700 1 Processor -- start 2020-11-20T11:46:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.312+0000 7f4b02f47700 1 -- start start 2020-11-20T11:46:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 0x7f4afc0c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 0x7f4afc162530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4afc155eb0 0x7f4afc144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc146070 con 0x7f4afc09cf30 2020-11-20T11:46:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc162a20 con 0x7f4afc155eb0 2020-11-20T11:46:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b02f47700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc1462a0 con 0x7f4afc09d310 2020-11-20T11:46:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 0x7f4afc162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:06.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 0x7f4afc0c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:06.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 0x7f4afc162530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42662/0 (socket says 172.21.15.105:42662) 2020-11-20T11:46:06.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4afbfff700 1 -- 172.21.15.105:0/379135336 learned_addr learned my addr 172.21.15.105:0/379135336 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:06.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b014e4700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4afc155eb0 0x7f4afc144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:06.322 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 -- 172.21.15.105:0/379135336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 msgr2=0x7f4afc162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 0x7f4afc162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 -- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4afc155eb0 msgr2=0x7f4afc144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4afc155eb0 0x7f4afc144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.313+0000 7f4b00ce3700 1 -- 172.21.15.105:0/379135336 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc146540 con 0x7f4afc09cf30 2020-11-20T11:46:06.323 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4b00ce3700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 0x7f4afc0c2630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4af0001320 tx=0x7f4af00027f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00072e0 con 0x7f4afc09cf30 2020-11-20T11:46:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af00054c0 con 0x7f4afc09cf30 2020-11-20T11:46:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0005840 con 0x7f4afc09cf30 2020-11-20T11:46:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc1467e0 con 0x7f4afc09cf30 2020-11-20T11:46:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.314+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc146d20 con 0x7f4afc09cf30 2020-11-20T11:46:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.315+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc146ee0 con 0x7f4afc09cf30 2020-11-20T11:46:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.315+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4af0010070 con 0x7f4afc09cf30 2020-11-20T11:46:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.316+0000 7f4af8ff9700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 0x7f4ad4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.316+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4af00a1fa0 con 0x7f4afc09cf30 2020-11-20T11:46:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.316+0000 7f4afbfff700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 0x7f4ad4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:06.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.316+0000 7f4afbfff700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 0x7f4ad4082af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4afc147a80 tx=0x7f4ae8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:06.326 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.320+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4af0076950 con 0x7f4afc09cf30 2020-11-20T11:46:06.569 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.565+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4afc044f60 con 0x7f4ad4080630 2020-11-20T11:46:06.578 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.575+0000 7f4af8ff9700 1 -- 172.21.15.105:0/379135336 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+150576 (secure 0 0 0) 0x7f4afc044f60 con 0x7f4ad4080630 2020-11-20T11:46:06.582 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:46:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.581+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 msgr2=0x7f4ad4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.581+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 0x7f4ad4082af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4afc147a80 tx=0x7f4ae8015000).stop 2020-11-20T11:46:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 msgr2=0x7f4afc0c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 0x7f4afc0c2630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4af0001320 tx=0x7f4af00027f0).stop 2020-11-20T11:46:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 shutdown_connections 2020-11-20T11:46:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4afc155eb0 0x7f4afc144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4afc09cf30 0x7f4afc0c2630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f4ad4080630 0x7f4ad4082af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.590 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 --2- 172.21.15.105:0/379135336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4afc09d310 0x7f4afc162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:06.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 >> 172.21.15.105:0/379135336 conn(0x7f4afc060130 msgr2=0x7f4afc1484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:06.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 shutdown_connections 2020-11-20T11:46:06.591 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:06.582+0000 7f4b02f47700 1 -- 172.21.15.105:0/379135336 wait complete. 2020-11-20T11:46:06.591 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:46:06.598 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2020-11-20T11:46:05.462864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7445294135,"num_objects":1802,"num_object_clones":0,"num_object_copies":7152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1802,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":286439,"num_write_kb":14242166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82242,"ondisk_log_size":82242,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":18035128,"kb_used_data":15087832,"kb_used_omap":0,"kb_used_meta":2943104,"kb_avail":1114426952,"statfs":{"total":1159641169920,"available":1141173198848,"internally_reserved":0,"allocated":15449939968,"data_stored":15447974380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3013738496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,3,4,4,7,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":167,"apply_latency_ms":167,"commit_latency_ns":167000000,"apply_latency_ns":167000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4056038280,"num_objects":-971,"num_object_clones":0,"num_object_copies":-3884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":973,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002415"},"pg_stats":[{"pgid":"4.2","version":"28'15159","reported_seq":"15169","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:03.454371+0000","last_change":"2020-11-20T11:29:31.810475+0000","last_active":"2020-11-20T11:46:03.454371+0000","last_peered":"2020-11-20T11:46:03.454371+0000","last_clean":"2020-11-20T11:46:03.454371+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:46:03.454371+0000","last_undegraded":"2020-11-20T11:46:03.454371+0000","last_fullsized":"2020-11-20T11:46:03.454371+0000","mapping_epoch":26,"log_start":"28'5117","ondisk_log_start":"28'5117","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10042,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":922875811,"num_objects":221,"num_object_clones":0,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36090,"num_write_kb":1834562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.808195+0000","last_change":"2020-11-20T11:29:25.767208+0000","last_active":"2020-11-20T11:29:31.808195+0000","last_peered":"2020-11-20T11:29:31.808195+0000","last_clean":"2020-11-20T11:29:31.808195+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:29:31.808195+0000","last_undegraded":"2020-11-20T11:29:31.808195+0000","last_fullsized":"2020-11-20T11:29:31.808195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'29","reported_seq":"41","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:48.468718+0000","last_change":"2020-11-20T11:29:28.782434+0000","last_active":"2020-11-20T11:45:48.468718+0000","last_peered":"2020-11-20T11:45:48.468718+0000","last_clean":"2020-11-20T11:45:48.468718+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:45:48.468718+0000","last_undegraded":"2020-11-20T11:45:48.468718+0000","last_fullsized":"2020-11-20T11:45:48.468718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"28'13998","reported_seq":"14009","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.668830+0000","last_change":"2020-11-20T11:29:31.798351+0000","last_active":"2020-11-20T11:46:02.668830+0000","last_peered":"2020-11-20T11:46:02.668830+0000","last_clean":"2020-11-20T11:46:02.668830+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:46:02.668830+0000","last_undegraded":"2020-11-20T11:46:02.668830+0000","last_fullsized":"2020-11-20T11:46:02.668830+0000","mapping_epoch":26,"log_start":"28'3974","ondisk_log_start":"28'3974","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10024,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34217,"num_write_kb":1663140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:00.879051+0000","last_change":"2020-11-20T11:46:00.879131+0000","last_active":"2020-11-20T11:46:00.879051+0000","last_peered":"2020-11-20T11:46:00.879051+0000","last_clean":"2020-11-20T11:46:00.879051+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:46:00.879051+0000","last_undegraded":"2020-11-20T11:46:00.879051+0000","last_fullsized":"2020-11-20T11:46:00.879051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_clean_scrub_stamp":"2020-11-20T11:46:00.879043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'1051","reported_seq":"1065","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.125071+0000","last_change":"2020-11-20T11:45:59.125193+0000","last_active":"2020-11-20T11:45:59.125071+0000","last_peered":"2020-11-20T11:45:59.125071+0000","last_clean":"2020-11-20T11:45:59.125071+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:45:59.125071+0000","last_undegraded":"2020-11-20T11:45:59.125071+0000","last_fullsized":"2020-11-20T11:45:59.125071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1051","last_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_deep_scrub":"28'1051","last_deep_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.125062+0000","log_size":1051,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4421052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":4629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"28'13996","reported_seq":"14007","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.498935+0000","last_change":"2020-11-20T11:29:31.800906+0000","last_active":"2020-11-20T11:46:02.498935+0000","last_peered":"2020-11-20T11:46:02.498935+0000","last_clean":"2020-11-20T11:46:02.498935+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:46:02.498935+0000","last_undegraded":"2020-11-20T11:46:02.498935+0000","last_fullsized":"2020-11-20T11:46:02.498935+0000","mapping_epoch":26,"log_start":"28'3937","ondisk_log_start":"28'3937","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10059,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33682,"num_write_kb":1743294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.791132+0000","last_change":"2020-11-20T11:29:25.767097+0000","last_active":"2020-11-20T11:29:31.791132+0000","last_peered":"2020-11-20T11:29:31.791132+0000","last_clean":"2020-11-20T11:29:31.791132+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:29:31.791132+0000","last_undegraded":"2020-11-20T11:29:31.791132+0000","last_fullsized":"2020-11-20T11:29:31.791132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'17","reported_seq":"32","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:01.615744+0000","last_change":"2020-11-20T11:46:01.615821+0000","last_active":"2020-11-20T11:46:01.615744+0000","last_peered":"2020-11-20T11:46:01.615744+0000","last_clean":"2020-11-20T11:46:01.615744+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:46:01.615744+0000","last_undegraded":"2020-11-20T11:46:01.615744+0000","last_fullsized":"2020-11-20T11:46:01.615744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_clean_scrub_stamp":"2020-11-20T11:46:01.615737+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'14456","reported_seq":"14467","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.108876+0000","last_change":"2020-11-20T11:29:31.810409+0000","last_active":"2020-11-20T11:46:02.108876+0000","last_peered":"2020-11-20T11:46:02.108876+0000","last_clean":"2020-11-20T11:46:02.108876+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:46:02.108876+0000","last_undegraded":"2020-11-20T11:46:02.108876+0000","last_fullsized":"2020-11-20T11:46:02.108876+0000","mapping_epoch":26,"log_start":"28'4432","ondisk_log_start":"28'4432","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10024,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":956301312,"num_objects":228,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34910,"num_write_kb":1743800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806853+0000","last_change":"2020-11-20T11:29:25.810118+0000","last_active":"2020-11-20T11:29:31.806853+0000","last_peered":"2020-11-20T11:29:31.806853+0000","last_clean":"2020-11-20T11:29:31.806853+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:29:31.806853+0000","last_undegraded":"2020-11-20T11:29:31.806853+0000","last_fullsized":"2020-11-20T11:29:31.806853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793781+0000","last_change":"2020-11-20T11:29:17.224872+0000","last_active":"2020-11-20T11:29:31.793781+0000","last_peered":"2020-11-20T11:29:31.793781+0000","last_clean":"2020-11-20T11:29:31.793781+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:29:31.793781+0000","last_undegraded":"2020-11-20T11:29:31.793781+0000","last_fullsized":"2020-11-20T11:29:31.793781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:11.234877+0000","last_clean_scrub_stamp":"2020-11-20T11:29:11.234877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:30:47.213189+0000","last_change":"2020-11-20T11:29:28.947687+0000","last_active":"2020-11-20T11:30:47.213189+0000","last_peered":"2020-11-20T11:30:47.213189+0000","last_clean":"2020-11-20T11:30:47.213189+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:30:47.213189+0000","last_undegraded":"2020-11-20T11:30:47.213189+0000","last_fullsized":"2020-11-20T11:30:47.213189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'14337","reported_seq":"14348","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.862584+0000","last_change":"2020-11-20T11:29:31.796907+0000","last_active":"2020-11-20T11:46:02.862584+0000","last_peered":"2020-11-20T11:46:02.862584+0000","last_clean":"2020-11-20T11:46:02.862584+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:46:02.862584+0000","last_undegraded":"2020-11-20T11:46:02.862584+0000","last_fullsized":"2020-11-20T11:46:02.862584+0000","mapping_epoch":26,"log_start":"28'4250","ondisk_log_start":"28'4250","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10087,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":935329792,"num_objects":223,"num_object_clones":0,"num_object_copies":892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34192,"num_write_kb":1724632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.924469+0000","last_change":"2020-11-20T11:45:59.924526+0000","last_active":"2020-11-20T11:45:59.924469+0000","last_peered":"2020-11-20T11:45:59.924469+0000","last_clean":"2020-11-20T11:45:59.924469+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:45:59.924469+0000","last_undegraded":"2020-11-20T11:45:59.924469+0000","last_fullsized":"2020-11-20T11:45:59.924469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.924465+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'66","reported_seq":"102","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.948476+0000","last_change":"2020-11-20T11:29:28.783019+0000","last_active":"2020-11-20T11:45:49.948476+0000","last_peered":"2020-11-20T11:45:49.948476+0000","last_clean":"2020-11-20T11:45:49.948476+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:45:49.948476+0000","last_undegraded":"2020-11-20T11:45:49.948476+0000","last_fullsized":"2020-11-20T11:45:49.948476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":68,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'15618","reported_seq":"15628","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:03.455303+0000","last_change":"2020-11-20T11:29:31.810862+0000","last_active":"2020-11-20T11:46:03.455303+0000","last_peered":"2020-11-20T11:46:03.455303+0000","last_clean":"2020-11-20T11:46:03.455303+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:46:03.455303+0000","last_undegraded":"2020-11-20T11:46:03.455303+0000","last_fullsized":"2020-11-20T11:46:03.455303+0000","mapping_epoch":26,"log_start":"28'5597","ondisk_log_start":"28'5597","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":968884224,"num_objects":231,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37452,"num_write_kb":1831709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793228+0000","last_change":"2020-11-20T11:29:25.765870+0000","last_active":"2020-11-20T11:29:31.793228+0000","last_peered":"2020-11-20T11:29:31.793228+0000","last_clean":"2020-11-20T11:29:31.793228+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:29:31.793228+0000","last_undegraded":"2020-11-20T11:29:31.793228+0000","last_fullsized":"2020-11-20T11:29:31.793228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'558","reported_seq":"570","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.324727+0000","last_change":"2020-11-20T11:29:28.781951+0000","last_active":"2020-11-20T11:45:49.324727+0000","last_peered":"2020-11-20T11:45:49.324727+0000","last_clean":"2020-11-20T11:45:49.324727+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:45:49.324727+0000","last_undegraded":"2020-11-20T11:45:49.324727+0000","last_fullsized":"2020-11-20T11:45:49.324727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":558,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'14839","reported_seq":"14850","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.560117+0000","last_change":"2020-11-20T11:29:31.810620+0000","last_active":"2020-11-20T11:46:02.560117+0000","last_peered":"2020-11-20T11:46:02.560117+0000","last_clean":"2020-11-20T11:46:02.560117+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:46:02.560117+0000","last_undegraded":"2020-11-20T11:46:02.560117+0000","last_fullsized":"2020-11-20T11:46:02.560117+0000","mapping_epoch":26,"log_start":"28'4792","ondisk_log_start":"28'4792","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36637,"num_write_kb":1763006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'10","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:48.403300+0000","last_change":"2020-11-20T11:29:28.835613+0000","last_active":"2020-11-20T11:45:48.403300+0000","last_peered":"2020-11-20T11:45:48.403300+0000","last_clean":"2020-11-20T11:45:48.403300+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:45:48.403300+0000","last_undegraded":"2020-11-20T11:45:48.403300+0000","last_fullsized":"2020-11-20T11:45:48.403300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.788241+0000","last_change":"2020-11-20T11:29:26.041682+0000","last_active":"2020-11-20T11:29:31.788241+0000","last_peered":"2020-11-20T11:29:31.788241+0000","last_clean":"2020-11-20T11:29:31.788241+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:29:31.788241+0000","last_undegraded":"2020-11-20T11:29:31.788241+0000","last_fullsized":"2020-11-20T11:29:31.788241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'15568","reported_seq":"15579","reported_epoch":"28","state":"active+clean+scrubbing+deep","last_fresh":"2020-11-20T11:46:03.914359+0000","last_change":"2020-11-20T11:46:02.622377+0000","last_active":"2020-11-20T11:46:03.914359+0000","last_peered":"2020-11-20T11:46:03.914359+0000","last_clean":"2020-11-20T11:46:03.914359+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:46:03.914359+0000","last_undegraded":"2020-11-20T11:46:03.914359+0000","last_fullsized":"2020-11-20T11:46:03.914359+0000","mapping_epoch":26,"log_start":"28'5504","ondisk_log_start":"28'5504","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10064,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":939524096,"num_objects":224,"num_object_clones":0,"num_object_copies":896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37194,"num_write_kb":1928765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.793857+0000","last_change":"2020-11-20T11:29:25.765016+0000","last_active":"2020-11-20T11:29:31.793857+0000","last_peered":"2020-11-20T11:29:31.793857+0000","last_clean":"2020-11-20T11:29:31.793857+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:29:31.793857+0000","last_undegraded":"2020-11-20T11:29:31.793857+0000","last_fullsized":"2020-11-20T11:29:31.793857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'136","reported_seq":"148","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:50.917476+0000","last_change":"2020-11-20T11:29:28.780167+0000","last_active":"2020-11-20T11:45:50.917476+0000","last_peered":"2020-11-20T11:45:50.917476+0000","last_clean":"2020-11-20T11:45:50.917476+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:45:50.917476+0000","last_undegraded":"2020-11-20T11:45:50.917476+0000","last_fullsized":"2020-11-20T11:45:50.917476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":136,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":7436629923,"num_objects":1774,"num_object_clones":0,"num_object_copies":7096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":284374,"num_write_kb":14232908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15070396416,"data_stored":15070396416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80368,"ondisk_log_size":80368,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8664212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":2062,"num_write_kb":9243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17391616,"data_stored":17328424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1871,"ondisk_log_size":1871,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444236,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147608,"kb_used_data":954704,"kb_used_omap":0,"kb_used_meta":190848,"kb_avail":93224232,"statfs":{"total":96636764160,"available":95461613568,"internally_reserved":0,"allocated":977616896,"data_stored":977456689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":195428352},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.61599999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3029999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.034,"15min":1.1519999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3919999999999999,"5min":2.8980000000000001,"15min":6.468},"last":1.2110000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.349,"15min":1.446},"min":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.621},"max":{"1min":1.655,"5min":12.504,"15min":12.504},"last":1.052},{"interface":"front","average":{"1min":1.03,"5min":1.1579999999999999,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.1779999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.96899999999999997,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.59899999999999998},"max":{"1min":1.2749999999999999,"5min":4.5279999999999996,"15min":4.5730000000000004},"last":1.085},{"interface":"front","average":{"1min":1.278,"5min":1.381,"15min":1.498},"min":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.659}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":4.8010000000000002,"15min":4.1719999999999997},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.8979999999999999,"5min":52.670000000000002,"15min":52.670000000000002},"last":28.181999999999999},{"interface":"front","average":{"1min":1.181,"5min":5.0209999999999999,"15min":4.2240000000000002},"min":{"1min":0.81000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.839,"5min":52.637,"15min":52.637},"last":28.161000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.522},"min":{"1min":0.97799999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2000000000000002,"5min":4.2939999999999996,"15min":5.0599999999999996},"last":1.454},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2729999999999999,"15min":1.4530000000000001},"min":{"1min":0.95799999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9410000000000001,"5min":5.2530000000000001,"15min":9.0850000000000009},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.7589999999999999,"15min":1.8440000000000001},"min":{"1min":1.2110000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.6470000000000002,"5min":5.9199999999999999,"15min":5.9199999999999999},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6850000000000001,"15min":1.7509999999999999},"min":{"1min":1.29,"5min":1.034,"15min":0.98699999999999999},"max":{"1min":4.6829999999999998,"5min":5.8739999999999997,"15min":6.9279999999999999},"last":1.635}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5640000000000001,"15min":1.9119999999999999},"min":{"1min":1.0600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0960000000000001,"5min":4.8579999999999997,"15min":69.603999999999999},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.77,"5min":1.7430000000000001,"15min":2.077},"min":{"1min":1.2430000000000001,"5min":1.151,"15min":1.151},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":66.614999999999995},"last":1.8009999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.641,"15min":1.823},"min":{"1min":1.1419999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.242,"5min":4.9800000000000004,"15min":6.2759999999999998},"last":1.419},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.7909999999999999,"15min":1.98},"min":{"1min":1.2989999999999999,"5min":1.2230000000000001,"15min":1.208},"max":{"1min":5.2910000000000004,"5min":5.2910000000000004,"15min":5.4790000000000001},"last":1.929}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.9610000000000001,"15min":2.0459999999999998},"min":{"1min":1.403,"5min":1.3540000000000001,"15min":1.218},"max":{"1min":5.3650000000000002,"5min":6.4669999999999996,"15min":6.6299999999999999},"last":2.1419999999999999},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.74,"15min":1.7689999999999999},"min":{"1min":1.204,"5min":1.139,"15min":1.0580000000000001},"max":{"1min":5.1509999999999998,"5min":5.2080000000000002,"15min":5.2080000000000002},"last":1.776}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.905,"15min":2.8690000000000002},"min":{"1min":1.2090000000000001,"5min":1.085,"15min":1.085},"max":{"1min":3.7410000000000001,"5min":7.0149999999999997,"15min":34.558},"last":6.9109999999999996},{"interface":"front","average":{"1min":2.004,"5min":2.0249999999999999,"15min":2.9969999999999999},"min":{"1min":1.486,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4290000000000003,"5min":6.9260000000000002,"15min":33.133000000000003},"last":7.173}]}]},{"osd":10,"up_from":17,"seq":73014444235,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1650344,"kb_used_data":1370400,"kb_used_omap":0,"kb_used_meta":279936,"kb_avail":92721496,"statfs":{"total":96636764160,"available":94946811904,"internally_reserved":0,"allocated":1403289600,"data_stored":1403131067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":286654464},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.2729999999999997,"5min":9.9610000000000003,"15min":7.29},"min":{"1min":0.71899999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":23.876999999999999,"5min":75.784000000000006,"15min":75.784000000000006},"last":14.938000000000001},{"interface":"front","average":{"1min":6.9729999999999999,"5min":10.032999999999999,"15min":7.5670000000000002},"min":{"1min":0.76300000000000001,"5min":0.63,"15min":0.60099999999999998},"max":{"1min":24.201000000000001,"5min":75.831000000000003,"15min":75.831000000000003},"last":14.832000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.387,"15min":1.7370000000000001},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.57199999999999995},"max":{"1min":2.3650000000000002,"5min":20.370000000000001,"15min":31.071000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.4830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.891,"5min":24.312999999999999,"15min":24.312999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5129999999999999,"15min":1.782},"min":{"1min":0.88,"5min":0.57099999999999995,"15min":0.54500000000000004},"max":{"1min":3.9740000000000002,"5min":20.204000000000001,"15min":25.420999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.319,"15min":1.708},"min":{"1min":0.72899999999999998,"5min":0.67400000000000004,"15min":0.53500000000000003},"max":{"1min":2.6280000000000001,"5min":2.9380000000000002,"15min":20.030999999999999},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":4.7720000000000002,"15min":5.4279999999999999},"min":{"1min":0.69199999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":25.651,"5min":35.222999999999999,"15min":43.152999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.8839999999999999,"5min":6.4249999999999998,"15min":6.3109999999999999},"min":{"1min":0.93600000000000005,"5min":0.91100000000000003,"15min":0.84199999999999997},"max":{"1min":25.908999999999999,"5min":44.122,"15min":46.593000000000004},"last":15.742000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8799999999999999,"15min":2.3180000000000001},"min":{"1min":0.66600000000000004,"5min":0.66000000000000003,"15min":0.63},"max":{"1min":4.1159999999999997,"5min":26.366,"15min":26.366},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.089,"15min":2.3679999999999999},"min":{"1min":0.83299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.7519999999999998,"5min":40.494,"15min":40.494},"last":1.0229999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.2160000000000002,"15min":2.2639999999999998},"min":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.59499999999999997},"max":{"1min":2.0209999999999999,"5min":25.873999999999999,"15min":25.873999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.7470000000000001,"5min":2.032,"15min":2.5379999999999998},"min":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":4.2229999999999999,"5min":23.809000000000001,"15min":25.771000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.282,"15min":2.5430000000000001},"min":{"1min":1.129,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.8809999999999998,"5min":23.800000000000001,"15min":24.831},"last":1.111},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.4209999999999998,"15min":2.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":2.9329999999999998,"5min":24.748999999999999,"15min":24.748999999999999},"last":1.093}]},{"osd":8,"last update":"Fri Nov 20 11:46:00 2020","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":2.504,"15min":2.9009999999999998},"min":{"1min":1.1080000000000001,"5min":0.82099999999999995,"15min":0.80200000000000005},"max":{"1min":26.579000000000001,"5min":26.579000000000001,"15min":26.579000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":3.2040000000000002,"5min":2.6219999999999999,"15min":3.0299999999999998},"min":{"1min":1.1639999999999999,"5min":0.92500000000000004,"15min":0.70499999999999996},"max":{"1min":26.748999999999999,"5min":40.624000000000002,"15min":40.624000000000002},"last":1.1910000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":2.7949999999999999,"15min":2.952},"min":{"1min":1.175,"5min":0.90900000000000003,"15min":0.81100000000000005},"max":{"1min":2.4159999999999999,"5min":26.437000000000001,"15min":29.969999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.347,"15min":2.9790000000000001},"min":{"1min":1.1899999999999999,"5min":0.97299999999999998,"15min":0.80100000000000005},"max":{"1min":4.4459999999999997,"5min":25.498999999999999,"15min":29.881},"last":1.2869999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":2.2789999999999999,"15min":2.9380000000000002},"min":{"1min":1.427,"5min":1.004,"15min":1.004},"max":{"1min":3.0430000000000001,"5min":22.917000000000002,"15min":30.013999999999999},"last":1.258},{"interface":"front","average":{"1min":1.7909999999999999,"5min":2.641,"15min":3.1320000000000001},"min":{"1min":1.2909999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3290000000000002,"5min":25.626000000000001,"15min":28.550999999999998},"last":1.325}]}]},{"osd":9,"up_from":17,"seq":73014444235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2304652,"kb_used_data":1933892,"kb_used_omap":0,"kb_used_meta":370752,"kb_avail":92067188,"statfs":{"total":96636764160,"available":94276800512,"internally_reserved":0,"allocated":1980305408,"data_stored":1980140151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":379650048},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":0.93999999999999995},"min":{"1min":0.76000000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.331,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.70899999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.9330000000000001,"5min":5.3170000000000002,"15min":6.7969999999999997},"last":1.524}]},{"osd":1,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":8.2119999999999997,"15min":6.3630000000000004},"min":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.65100000000000002},"max":{"1min":16.420999999999999,"5min":37.811999999999998,"15min":114.867},"last":1.762},{"interface":"front","average":{"1min":2.7330000000000001,"5min":8.1440000000000001,"15min":6.1429999999999998},"min":{"1min":0.73899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":16.260999999999999,"5min":37.152999999999999,"15min":114.36799999999999},"last":1.143}]},{"osd":2,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.248,"15min":1.6040000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7050000000000001,"5min":7.0990000000000002,"15min":53.234000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.3580000000000001,"15min":1.669},"min":{"1min":0.88900000000000001,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.8720000000000001,"5min":5.5919999999999996,"15min":54.753},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.405,"15min":1.3879999999999999},"min":{"1min":0.81299999999999994,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.768,"5min":5.6390000000000002,"15min":7.2080000000000002},"last":10.167999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.4610000000000001,"15min":1.411},"min":{"1min":1.097,"5min":0.746,"15min":0.746},"max":{"1min":1.899,"5min":7.234,"15min":7.234},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":4.5919999999999996,"15min":3.927},"min":{"1min":1.246,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0139999999999998,"5min":37.531999999999996,"15min":84.661000000000001},"last":54.780000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":4.6280000000000001,"15min":3.9750000000000001},"min":{"1min":1.0069999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.327,"5min":37.469000000000001,"15min":84.811000000000007},"last":54.984000000000002}]},{"osd":5,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":1.804},"min":{"1min":1.012,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0960000000000001,"5min":7.3639999999999999,"15min":53.052},"last":9.9870000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.702,"15min":1.869},"min":{"1min":1.321,"5min":1.05,"15min":1.0189999999999999},"max":{"1min":2.137,"5min":6.1299999999999999,"15min":53.853000000000002},"last":9.7750000000000004}]},{"osd":6,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.7330000000000001,"15min":1.706},"min":{"1min":1.1919999999999999,"5min":1.03,"15min":1.03},"max":{"1min":2.0630000000000002,"5min":5.7720000000000002,"15min":7.3410000000000002},"last":10.035},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.698,"15min":1.7110000000000001},"min":{"1min":1.1719999999999999,"5min":1,"15min":0.84399999999999997},"max":{"1min":2.282,"5min":7.5979999999999999,"15min":9.0199999999999996},"last":1.3160000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.869,"15min":2.1190000000000002},"min":{"1min":1.3029999999999999,"5min":1.163,"15min":1.163},"max":{"1min":2.2629999999999999,"5min":7.7619999999999996,"15min":54.600999999999999},"last":1.29},{"interface":"front","average":{"1min":1.706,"5min":1.893,"15min":2.2789999999999999},"min":{"1min":1.276,"5min":1.139,"15min":1.139},"max":{"1min":2.1989999999999998,"5min":9.8450000000000006,"15min":55.698},"last":1.8660000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8899999999999999,"15min":2.6320000000000001},"min":{"1min":1.3400000000000001,"5min":1.2430000000000001,"15min":1.2},"max":{"1min":3.1179999999999999,"5min":7.484,"15min":21.552},"last":10.122999999999999},{"interface":"front","average":{"1min":1.802,"5min":1.958,"15min":2.5529999999999999},"min":{"1min":1.411,"5min":1.173,"15min":1.0760000000000001},"max":{"1min":3.1389999999999998,"5min":6.9050000000000002,"15min":21.600999999999999},"last":9.9100000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.9239999999999999,"15min":2.0880000000000001},"min":{"1min":1.3240000000000001,"5min":1.2290000000000001,"15min":1.157},"max":{"1min":2.468,"5min":6.0499999999999998,"15min":53.317},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.9179999999999999,"15min":2.1309999999999998},"min":{"1min":1.4159999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.23,"5min":7.7270000000000003,"15min":53.140000000000001},"last":1.4370000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444235,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1654456,"kb_used_data":1376560,"kb_used_omap":0,"kb_used_meta":275840,"kb_avail":92717384,"statfs":{"total":96636764160,"available":94942601216,"internally_reserved":0,"allocated":1409597440,"data_stored":1409423326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":282460160},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":1.3009999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":71.022999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98699999999999999,"15min":1.3839999999999999},"min":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.56100000000000005},"max":{"1min":2.827,"5min":6.1589999999999998,"15min":70.582999999999998},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":7.8869999999999996,"15min":5.6749999999999998},"min":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":9.5350000000000001,"5min":54.277999999999999,"15min":55.158999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":2.2290000000000001,"5min":8.3379999999999992,"15min":5.9969999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":10.224,"5min":54.159999999999997,"15min":55.703000000000003},"last":1.054}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.24,"15min":1.391},"min":{"1min":0.68400000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.9950000000000001,"5min":4.9950000000000001,"15min":8.8699999999999992},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2050000000000001,"15min":1.2390000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.624},"max":{"1min":5.0270000000000001,"5min":5.7990000000000004,"15min":6.0810000000000004},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2989999999999999,"15min":1.7529999999999999},"min":{"1min":0.91100000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1230000000000002,"5min":6.4059999999999997,"15min":70.391000000000005},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.8240000000000001},"min":{"1min":1.034,"5min":0.98999999999999999,"15min":0.94999999999999996},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":70.510000000000005},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":4.891,"15min":4.5730000000000004},"min":{"1min":1.077,"5min":0.94299999999999995,"15min":0.88300000000000001},"max":{"1min":17.567,"5min":49.796999999999997,"15min":88.828000000000003},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.468,"15min":4.1710000000000003},"min":{"1min":1.016,"5min":0.72499999999999998,"15min":0.69899999999999995},"max":{"1min":17.832999999999998,"5min":49.468000000000004,"15min":88.775999999999996},"last":2.6339999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3440000000000001,"15min":1.534},"min":{"1min":0.96399999999999997,"5min":0.84499999999999997,"15min":0.75900000000000001},"max":{"1min":2.0070000000000001,"5min":2.3530000000000002,"15min":8.2010000000000005},"last":1.022},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.585,"15min":1.871},"min":{"1min":1.133,"5min":1.0389999999999999,"15min":0.90300000000000002},"max":{"1min":2.4489999999999998,"5min":6.3109999999999999,"15min":19.702999999999999},"last":1.454}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.8819999999999999,"15min":2.0110000000000001},"min":{"1min":1.202,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2280000000000002,"5min":18.169,"15min":18.169},"last":1.657},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.8,"15min":1.966},"min":{"1min":1.2370000000000001,"5min":1.1439999999999999,"15min":1.125},"max":{"1min":5.9939999999999998,"5min":5.9939999999999998,"15min":9.4499999999999993},"last":1.0780000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.5660000000000001,"15min":1.911},"min":{"1min":1.1060000000000001,"5min":1.034,"15min":1.0029999999999999},"max":{"1min":1.6559999999999999,"5min":7.7770000000000001,"15min":70.606999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.8859999999999999,"15min":2.3140000000000001},"min":{"1min":1.2689999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3370000000000002,"5min":18.033999999999999,"15min":75.585999999999999},"last":1.595}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":2.2549999999999999,"15min":3.2029999999999998},"min":{"1min":1.3360000000000001,"5min":1.2170000000000001,"15min":1.171},"max":{"1min":7.077,"5min":13.571,"15min":73.167000000000002},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.663,"5min":2.04,"15min":3.0230000000000001},"min":{"1min":1.393,"5min":1.22,"15min":0.90000000000000002},"max":{"1min":3.3119999999999998,"5min":13.545999999999999,"15min":73.046999999999997},"last":1.1930000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":2.0579999999999998,"15min":2.242},"min":{"1min":1.29,"5min":1.29,"15min":1.1519999999999999},"max":{"1min":3.762,"5min":18.279,"15min":18.279},"last":1.53},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.8149999999999999,"15min":2.0550000000000002},"min":{"1min":1.302,"5min":1.2729999999999999,"15min":1.1699999999999999},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":9.359},"last":1.3009999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444235,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132272,"kb_used_data":960872,"kb_used_omap":0,"kb_used_meta":171392,"kb_avail":93239568,"statfs":{"total":96636764160,"available":95477317632,"internally_reserved":0,"allocated":983932928,"data_stored":983766778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":175505408},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.1359999999999999},"min":{"1min":0.55100000000000005,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":1.667,"5min":3.9369999999999998,"15min":39.671999999999997},"last":1.052},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":1.1160000000000001},"min":{"1min":0.627,"5min":0.54700000000000004,"15min":0.496},"max":{"1min":2.7589999999999999,"5min":4.21,"15min":36.548000000000002},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":8.4309999999999992,"15min":6.0629999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.61499999999999999},"max":{"1min":17.905999999999999,"5min":51.244999999999997,"15min":115.669},"last":4.8659999999999997},{"interface":"front","average":{"1min":3.5960000000000001,"5min":9.0039999999999996,"15min":6.1980000000000004},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.63500000000000001},"max":{"1min":18.001000000000001,"5min":51.121000000000002,"15min":115.831},"last":4.9080000000000004}]},{"osd":2,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.421,"15min":1.6279999999999999},"min":{"1min":0.73399999999999999,"5min":0.63800000000000001,"15min":0.46800000000000003},"max":{"1min":3.2810000000000001,"5min":5.8120000000000003,"15min":52.776000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.355,"15min":1.5609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":6.931,"5min":8.5619999999999994,"15min":52.869999999999997},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2669999999999999,"15min":1.571},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.875,"5min":4.3300000000000001,"15min":39.496000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.639,"15min":1.651},"min":{"1min":0.93000000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.9020000000000001,"5min":6.7359999999999998,"15min":37.078000000000003},"last":0.89200000000000002}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":4.4820000000000002,"15min":4.7359999999999998},"min":{"1min":0.86499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.0940000000000003,"5min":29.015000000000001,"15min":115.108},"last":10.005000000000001},{"interface":"front","average":{"1min":1.611,"5min":4.843,"15min":4.9210000000000003},"min":{"1min":1.04,"5min":0.623,"15min":0.623},"max":{"1min":2.98,"5min":29.611999999999998,"15min":114.602},"last":10.363}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5409999999999999,"15min":1.6950000000000001},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.76600000000000001},"max":{"1min":3.1779999999999999,"5min":4.4539999999999997,"15min":37.802},"last":1.075},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.772,"15min":1.849},"min":{"1min":1.0189999999999999,"5min":0.89100000000000001,"15min":0.73599999999999999},"max":{"1min":3.1440000000000001,"5min":6.8920000000000003,"15min":37.234000000000002},"last":0.96799999999999997}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.476,"15min":1.752},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.60299999999999998},"max":{"1min":3.9750000000000001,"5min":4.9139999999999997,"15min":53.584000000000003},"last":1.206},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.73,"15min":1.9490000000000001},"min":{"1min":1.0429999999999999,"5min":0.84499999999999997,"15min":0.73299999999999998},"max":{"1min":3.0819999999999999,"5min":4.6929999999999996,"15min":52.744},"last":1.26}]},{"osd":9,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.847,"15min":2.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.028,"5min":7.1680000000000001,"15min":35.851999999999997},"last":1.121},{"interface":"front","average":{"1min":1.776,"5min":1.6000000000000001,"15min":1.7769999999999999},"min":{"1min":1.069,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":3.8559999999999999,"5min":4.1849999999999996,"15min":36.921999999999997},"last":1.389}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.925,"5min":1.9630000000000001,"15min":2.8180000000000001},"min":{"1min":1.171,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":3.411,"5min":8.5410000000000004,"15min":113.55800000000001},"last":13.657},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.9670000000000001,"15min":2.9940000000000002},"min":{"1min":1.103,"5min":1.0700000000000001,"15min":0.85799999999999998},"max":{"1min":3.286,"5min":7.0389999999999997,"15min":117.624},"last":14.087999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.7509999999999999,"15min":1.881},"min":{"1min":1.165,"5min":0.90200000000000002,"15min":0.77400000000000002},"max":{"1min":4.2169999999999996,"5min":4.8390000000000004,"15min":34.616999999999997},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.877,"5min":1.8859999999999999,"15min":1.986},"min":{"1min":1.3300000000000001,"5min":1.0569999999999999,"15min":0.96199999999999997},"max":{"1min":3.302,"5min":4.9199999999999999,"15min":34.640000000000001},"last":1.375}]}]},{"osd":6,"up_from":17,"seq":73014444236,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2295712,"kb_used_data":1925464,"kb_used_omap":0,"kb_used_meta":370240,"kb_avail":92076128,"statfs":{"total":96636764160,"available":94285955072,"internally_reserved":0,"allocated":1971675136,"data_stored":1971506897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":379125760},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,0,0,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":7.5279999999999996,"15min":5.0430000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.56299999999999994},"max":{"1min":21.082000000000001,"5min":61.689,"15min":61.689},"last":1.409},{"interface":"front","average":{"1min":2.2589999999999999,"5min":6.6390000000000002,"15min":4.8529999999999998},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"max":{"1min":14.728,"5min":44.164000000000001,"15min":44.350999999999999},"last":0.98899999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.3380000000000001,"5min":4.274,"15min":5.242},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0660000000000001,"15min":1.135},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56899999999999995},"max":{"1min":1.601,"5min":6.6609999999999996,"15min":7.4770000000000003},"last":1.9259999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.077,"15min":1.0720000000000001},"min":{"1min":0.69299999999999995,"5min":0.627,"15min":0.54000000000000004},"max":{"1min":2.3359999999999999,"5min":4.8360000000000003,"15min":8.2520000000000007},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.121},"min":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.60899999999999999},"max":{"1min":2.657,"5min":3.6000000000000001,"15min":5.758},"last":1.1950000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":4.1029999999999998,"15min":3.7599999999999998},"min":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.70299999999999996},"max":{"1min":11.422000000000001,"5min":54.881,"15min":54.881},"last":11.233000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":4.4870000000000001,"15min":3.931},"min":{"1min":1.008,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":11.472,"5min":54.957999999999998,"15min":54.957999999999998},"last":11.099}]},{"osd":5,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.546,"15min":1.466},"min":{"1min":0.90900000000000003,"5min":0.81000000000000005,"15min":0.60599999999999998},"max":{"1min":2.02,"5min":7.1909999999999998,"15min":7.7300000000000004},"last":6.0679999999999996},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4039999999999999,"15min":1.4450000000000001},"min":{"1min":0.88200000000000001,"5min":0.79200000000000004,"15min":0.72099999999999997},"max":{"1min":2.6859999999999999,"5min":6.4539999999999997,"15min":7.5419999999999998},"last":6.0220000000000002}]},{"osd":7,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.419,"15min":1.4630000000000001},"min":{"1min":0.88600000000000001,"5min":0.84499999999999997,"15min":0.72799999999999998},"max":{"1min":3.0059999999999998,"5min":5.1470000000000002,"15min":8.3800000000000008},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5309999999999999,"15min":1.506},"min":{"1min":1.0609999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5339999999999998,"5min":3.8460000000000001,"15min":6.0229999999999997},"last":1.5429999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.659,"15min":1.6120000000000001},"min":{"1min":1.155,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8660000000000001,"5min":7.4710000000000001,"15min":7.4710000000000001},"last":2.5630000000000002},{"interface":"front","average":{"1min":1.51,"5min":1.7909999999999999,"15min":1.8720000000000001},"min":{"1min":1.087,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.911,"5min":10.055999999999999,"15min":10.065},"last":2.206}]},{"osd":9,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.641,"15min":1.6419999999999999},"min":{"1min":1.228,"5min":1.0700000000000001,"15min":1.026},"max":{"1min":3.0059999999999998,"5min":4.4429999999999996,"15min":6.141},"last":1.8859999999999999},{"interface":"front","average":{"1min":1.663,"5min":1.76,"15min":1.679},"min":{"1min":1.252,"5min":0.98899999999999999,"15min":0.82699999999999996},"max":{"1min":2.4630000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":2.4239999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":1.8300000000000001,"15min":2.1739999999999999},"min":{"1min":1.288,"5min":1.145,"15min":1.145},"max":{"1min":2.8900000000000001,"5min":5.8179999999999996,"15min":18.337},"last":1.665},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.847,"15min":2.2440000000000002},"min":{"1min":1.1040000000000001,"5min":1.0569999999999999,"15min":0.93600000000000005},"max":{"1min":2.1030000000000002,"5min":7.6130000000000004,"15min":23.823},"last":30.346}]},{"osd":11,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.7130000000000001,"15min":1.7450000000000001},"min":{"1min":1.181,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":3.0720000000000001,"5min":6.6059999999999999,"15min":7.9660000000000002},"last":2.113},{"interface":"front","average":{"1min":1.736,"5min":1.845,"15min":1.796},"min":{"1min":1.357,"5min":1.163,"15min":1.119},"max":{"1min":2.7749999999999999,"5min":5.2089999999999996,"15min":6.2640000000000002},"last":1.774}]}]},{"osd":1,"up_from":17,"seq":73014444234,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1684016,"kb_used_data":1421672,"kb_used_omap":0,"kb_used_meta":262336,"kb_avail":92687824,"statfs":{"total":96636764160,"available":94912331776,"internally_reserved":0,"allocated":1455792128,"data_stored":1455626046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":268632064},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,0,0,1,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":5.0309999999999997,"15min":3.8330000000000002},"min":{"1min":0.72399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":19.308,"5min":44.576000000000001,"15min":57.322000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":3.7400000000000002,"5min":6.452,"15min":3.722},"min":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.61299999999999999},"max":{"1min":20.452999999999999,"5min":68.094999999999999,"15min":68.094999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":6.2800000000000002,"15min":4.6559999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"max":{"1min":19.183,"5min":64.680000000000007,"15min":64.680000000000007},"last":0.92800000000000005},{"interface":"front","average":{"1min":3.5950000000000002,"5min":5.2889999999999997,"15min":3.5449999999999999},"min":{"1min":0.66300000000000003,"5min":0.63,"15min":0.63},"max":{"1min":19.152999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.931,"5min":6.6050000000000004,"15min":4.4480000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":20.582000000000001,"5min":68.230000000000004,"15min":68.230000000000004},"last":0.98399999999999999},{"interface":"front","average":{"1min":5.9900000000000002,"5min":7.9950000000000001,"15min":5.2060000000000004},"min":{"1min":0.98999999999999999,"5min":0.85699999999999998,"15min":0.66900000000000004},"max":{"1min":19.859000000000002,"5min":64.951999999999998,"15min":64.951999999999998},"last":1.054}]},{"osd":4,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":17.652999999999999,"15min":11.912000000000001},"min":{"1min":0.87,"5min":0.71499999999999997,"15min":0.66000000000000003},"max":{"1min":20.414000000000001,"5min":68.141000000000005,"15min":68.141000000000005},"last":34.533999999999999},{"interface":"front","average":{"1min":6.157,"5min":16.033999999999999,"15min":11.202},"min":{"1min":0.76900000000000002,"5min":0.751,"15min":0.63500000000000001},"max":{"1min":19.780000000000001,"5min":68.816000000000003,"15min":68.816000000000003},"last":34.557000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.2050000000000001,"5min":6.8840000000000003,"15min":4.6050000000000004},"min":{"1min":0.84899999999999998,"5min":0.78500000000000003,"15min":0.76100000000000001},"max":{"1min":19.414000000000001,"5min":64.760999999999996,"15min":64.760999999999996},"last":1.1060000000000001},{"interface":"front","average":{"1min":7.2839999999999998,"5min":9.4559999999999995,"15min":5.976},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.81499999999999995},"max":{"1min":21.158999999999999,"5min":68.406000000000006,"15min":68.406000000000006},"last":2.5830000000000002}]},{"osd":7,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.5800000000000001,"5min":11.606,"15min":7.2130000000000001},"min":{"1min":1.1970000000000001,"5min":0.98699999999999999,"15min":0.73499999999999999},"max":{"1min":20.064,"5min":64.828999999999994,"15min":64.828999999999994},"last":2.6869999999999998},{"interface":"front","average":{"1min":9.4830000000000005,"5min":10.178000000000001,"15min":6.1470000000000002},"min":{"1min":1.1439999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":20.606999999999999,"5min":64.905000000000001,"15min":64.905000000000001},"last":2.2829999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":7.2530000000000001,"5min":9.9480000000000004,"15min":6.2359999999999998},"min":{"1min":1.1020000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":20.085000000000001,"5min":64.637,"15min":64.637},"last":2.161},{"interface":"front","average":{"1min":8.6590000000000007,"5min":12.173999999999999,"15min":7.04},"min":{"1min":1.173,"5min":0.98899999999999999,"15min":0.97499999999999998},"max":{"1min":21.402999999999999,"5min":85.200000000000003,"15min":85.200000000000003},"last":2.7280000000000002}]},{"osd":9,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":9.6660000000000004,"5min":13.859999999999999,"15min":7.4699999999999998},"min":{"1min":1.0549999999999999,"5min":1.048,"15min":1.036},"max":{"1min":21.271000000000001,"5min":85.361000000000004,"15min":85.361000000000004},"last":2.8559999999999999},{"interface":"front","average":{"1min":8.4830000000000005,"5min":11.747,"15min":7.782},"min":{"1min":1.3200000000000001,"5min":1.29,"15min":1.226},"max":{"1min":20.303999999999998,"5min":66.25,"15min":66.25},"last":2.5600000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":10.364000000000001,"5min":12.771000000000001,"15min":9.2509999999999994},"min":{"1min":1.242,"5min":1.181,"15min":1.079},"max":{"1min":20.744,"5min":65.650000000000006,"15min":75.225999999999999},"last":2.387},{"interface":"front","average":{"1min":11.446999999999999,"5min":14.766999999999999,"15min":10.284000000000001},"min":{"1min":1.476,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":21.491,"5min":85.747,"15min":85.747},"last":3.109}]},{"osd":11,"last update":"Fri Nov 20 11:45:09 2020","interfaces":[{"interface":"back","average":{"1min":15.535,"5min":17.238,"15min":8.7699999999999996},"min":{"1min":1.601,"5min":1.2769999999999999,"15min":1.2769999999999999},"max":{"1min":37.311999999999998,"5min":66.135999999999996,"15min":66.135999999999996},"last":2.8090000000000002},{"interface":"front","average":{"1min":18.657,"5min":19.195,"15min":8.7050000000000001},"min":{"1min":1.6200000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":37.133000000000003,"5min":85.456000000000003,"15min":85.456000000000003},"last":2.9870000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444236,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":599180,"kb_used_data":500228,"kb_used_omap":0,"kb_used_meta":98944,"kb_avail":93772660,"statfs":{"total":96636764160,"available":96023203840,"internally_reserved":0,"allocated":512233472,"data_stored":512068215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101318656},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":7.2279999999999998,"15min":5.0069999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.53100000000000003},"max":{"1min":16.285,"5min":46.543999999999997,"15min":46.543999999999997},"last":8.6170000000000009},{"interface":"front","average":{"1min":3.2719999999999998,"5min":7.3639999999999999,"15min":5.6900000000000004},"min":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.627},"max":{"1min":16.303999999999998,"5min":48.5,"15min":55.564},"last":7.5949999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1759999999999999,"15min":1.1000000000000001},"min":{"1min":0.76200000000000001,"5min":0.68799999999999994,"15min":0.499},"max":{"1min":1.4810000000000001,"5min":3.8690000000000002,"15min":4.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0509999999999999,"15min":1.0289999999999999},"min":{"1min":0.753,"5min":0.56799999999999995,"15min":0.53800000000000003},"max":{"1min":1.367,"5min":5.5209999999999999,"15min":5.5209999999999999},"last":1.4419999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":3.5489999999999999,"15min":3.3380000000000001},"min":{"1min":0.75700000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"max":{"1min":1.383,"5min":36.844999999999999,"15min":36.844999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":4.5350000000000001,"15min":3.8140000000000001},"min":{"1min":0.84699999999999998,"5min":0.81899999999999995,"15min":0.70599999999999996},"max":{"1min":1.6890000000000001,"5min":46.908000000000001,"15min":46.908000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.887,"15min":1.742},"min":{"1min":0.76300000000000001,"5min":0.73099999999999998,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":46.579000000000001,"15min":51.210999999999999},"last":1.595},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.0449999999999999,"15min":1.9430000000000001},"min":{"1min":1.1160000000000001,"5min":0.83999999999999997,"15min":0.68300000000000005},"max":{"1min":1.623,"5min":46.078000000000003,"15min":51.238},"last":1.548}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.105,"15min":1.6359999999999999},"min":{"1min":0.97299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0510000000000002,"5min":55.969999999999999,"15min":55.969999999999999},"last":1.53},{"interface":"front","average":{"1min":1.329,"5min":2.1339999999999999,"15min":1.6559999999999999},"min":{"1min":0.98799999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.825,"5min":57.426000000000002,"15min":57.426000000000002},"last":1.718}]},{"osd":7,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.0880000000000001,"15min":1.6919999999999999},"min":{"1min":1.0940000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0310000000000001,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.415},{"interface":"front","average":{"1min":1.6559999999999999,"5min":2.1930000000000001,"15min":1.7889999999999999},"min":{"1min":1.2769999999999999,"5min":1.0049999999999999,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":47.027000000000001,"15min":47.027000000000001},"last":1.1499999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":2.105,"15min":1.9590000000000001},"min":{"1min":1.0349999999999999,"5min":0.89600000000000002,"15min":0.65800000000000003},"max":{"1min":1.9490000000000001,"5min":47.246000000000002,"15min":50.509},"last":2.056},{"interface":"front","average":{"1min":1.5089999999999999,"5min":2.262,"15min":2.165},"min":{"1min":1.2929999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2,"5min":46.308,"15min":50.698},"last":1.6679999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:46:01 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":2.391,"15min":1.9630000000000001},"min":{"1min":1.4019999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":4.8070000000000004,"5min":47.418999999999997,"15min":47.418999999999997},"last":1.913},{"interface":"front","average":{"1min":1.8080000000000001,"5min":2.3460000000000001,"15min":1.887},"min":{"1min":1.246,"5min":0.94699999999999995,"15min":0.78600000000000003},"max":{"1min":4.7839999999999998,"5min":47.543999999999997,"15min":47.543999999999997},"last":2.173}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.73,"5min":2.617,"15min":3.093},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":0.98199999999999998},"max":{"1min":2.4140000000000001,"5min":47.140000000000001,"15min":47.140000000000001},"last":1.651},{"interface":"front","average":{"1min":1.6359999999999999,"5min":2.5,"15min":3.0379999999999998},"min":{"1min":1.3280000000000001,"5min":1.0640000000000001,"15min":0.95599999999999996},"max":{"1min":2.0489999999999999,"5min":46.703000000000003,"15min":46.703000000000003},"last":2.2949999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":2.4900000000000002,"15min":2.0510000000000002},"min":{"1min":1.4079999999999999,"5min":1.139,"15min":1.1160000000000001},"max":{"1min":2.1760000000000002,"5min":46.200000000000003,"15min":46.200000000000003},"last":1.794},{"interface":"front","average":{"1min":1.7,"5min":2.4769999999999999,"15min":2.0230000000000001},"min":{"1min":1.4019999999999999,"5min":1.286,"15min":1.127},"max":{"1min":2.0950000000000002,"5min":48.350000000000001,"15min":48.350000000000001},"last":1.768}]}]},{"osd":2,"up_from":17,"seq":73014444235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1642992,"kb_used_data":1374504,"kb_used_omap":0,"kb_used_meta":268480,"kb_avail":92728848,"statfs":{"total":96636764160,"available":94954340352,"internally_reserved":0,"allocated":1407492096,"data_stored":1407325946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":274923520},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":4.9550000000000001,"5min":8.9930000000000003,"15min":6.2279999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":16.984000000000002,"5min":47.216000000000001,"15min":77.983000000000004},"last":12.942},{"interface":"front","average":{"1min":5.7549999999999999,"5min":9.5549999999999997,"15min":6.3490000000000002},"min":{"1min":0.64800000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":28.588000000000001,"5min":44.024999999999999,"15min":78.215000000000003},"last":13.1}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.96499999999999997,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63200000000000001},"max":{"1min":5.3460000000000001,"5min":7.7690000000000001,"15min":9.4440000000000008},"last":0.873},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.105,"15min":1.161},"min":{"1min":0.70399999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5069999999999999,"5min":8.2140000000000004,"15min":9.6769999999999996},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.343,"5min":4.5300000000000002,"15min":3.9660000000000002},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.51900000000000002},"max":{"1min":92.447999999999993,"5min":92.447999999999993,"15min":92.447999999999993},"last":23.873000000000001},{"interface":"front","average":{"1min":6.7359999999999998,"5min":5.0519999999999996,"15min":4.3940000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.68000000000000005},"max":{"1min":92.543000000000006,"5min":92.543000000000006,"15min":92.543000000000006},"last":23.805}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.3049999999999999,"15min":1.502},"min":{"1min":0.83499999999999996,"5min":0.69299999999999995,"15min":0.58599999999999997},"max":{"1min":5.7679999999999998,"5min":8.7469999999999999,"15min":11.797000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4330000000000001,"15min":1.615},"min":{"1min":0.94099999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.931,"5min":8.0950000000000006,"15min":10.281000000000001},"last":1.1879999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.411},"min":{"1min":0.749,"5min":0.68200000000000005,"15min":0.67500000000000004},"max":{"1min":2.762,"5min":7.5339999999999998,"15min":9.3119999999999994},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.5469999999999999,"15min":1.6180000000000001},"min":{"1min":0.86599999999999999,"5min":0.83899999999999997,"15min":0.73899999999999999},"max":{"1min":5.899,"5min":11.779,"15min":11.779},"last":1.3200000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.7030000000000001,"15min":1.9710000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.80000000000000004},"max":{"1min":18.559000000000001,"5min":18.559000000000001,"15min":77.819999999999993},"last":1.6100000000000001},{"interface":"front","average":{"1min":2.8149999999999999,"5min":1.819,"15min":2.0129999999999999},"min":{"1min":1.101,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":31.295999999999999,"5min":31.295999999999999,"15min":78.126999999999995},"last":1.0860000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.7629999999999999,"15min":1.8640000000000001},"min":{"1min":1.002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":6.5039999999999996,"5min":8.5489999999999995,"15min":11.343999999999999},"last":1.53},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.756,"15min":2.0129999999999999},"min":{"1min":1.226,"5min":1.099,"15min":1.075},"max":{"1min":2.3610000000000002,"5min":8.6039999999999992,"15min":18.099},"last":1.7470000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.726,"15min":1.879},"min":{"1min":1.2609999999999999,"5min":1.083,"15min":1.0629999999999999},"max":{"1min":2.6150000000000002,"5min":8.3659999999999997,"15min":10.129},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.655,"15min":1.7689999999999999},"min":{"1min":1.1439999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.411,"5min":7.7460000000000004,"15min":9.4220000000000006},"last":1.5549999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.9219999999999999,"15min":2.7349999999999999},"min":{"1min":1.361,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.6520000000000001,"5min":7.8650000000000002,"15min":78.016000000000005},"last":1.643},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.909,"15min":2.8220000000000001},"min":{"1min":1.238,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":6.3799999999999999,"5min":8.0250000000000004,"15min":77.741},"last":1.4470000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.8580000000000001,"15min":2.0369999999999999},"min":{"1min":1.3879999999999999,"5min":1.246,"15min":1.2190000000000001},"max":{"1min":2.4969999999999999,"5min":8.7319999999999993,"15min":10.26},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.849,"15min":1.9830000000000001},"min":{"1min":1.405,"5min":1.113,"15min":1.113},"max":{"1min":2.5230000000000001,"5min":8.0540000000000003,"15min":9.6440000000000001},"last":1.7150000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444235,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":607208,"kb_used_data":502048,"kb_used_omap":0,"kb_used_meta":105152,"kb_avail":93764632,"statfs":{"total":96636764160,"available":96014983168,"internally_reserved":0,"allocated":514097152,"data_stored":513938619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":107675648},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Fri Nov 20 11:45:55 2020","interfaces":[{"interface":"back","average":{"1min":4.1420000000000003,"5min":8.718,"15min":5.8630000000000004},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":19.181000000000001,"5min":109.33199999999999,"15min":109.33199999999999},"last":1.24},{"interface":"front","average":{"1min":4.2060000000000004,"5min":8.9510000000000005,"15min":6.0069999999999997},"min":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":19.215,"5min":109.303,"15min":109.303},"last":2.2040000000000002}]},{"osd":2,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.97099999999999997,"15min":1.496},"min":{"1min":0.64900000000000002,"5min":0.59599999999999997,"15min":0.54900000000000004},"max":{"1min":1.4239999999999999,"5min":3.3220000000000001,"15min":80.936999999999998},"last":2.246},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.208,"15min":1.5},"min":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"max":{"1min":1.3140000000000001,"5min":8.2599999999999998,"15min":80.414000000000001},"last":2.3559999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":5.1989999999999998,"5min":5.2290000000000001,"15min":4.1050000000000004},"min":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.622},"max":{"1min":85.147999999999996,"5min":85.147999999999996,"15min":85.147999999999996},"last":8.0570000000000004},{"interface":"front","average":{"1min":5.2750000000000004,"5min":5.4850000000000003,"15min":4.2290000000000001},"min":{"1min":0.70299999999999996,"5min":0.64400000000000002,"15min":0.59299999999999997},"max":{"1min":85.228999999999999,"5min":85.228999999999999,"15min":85.228999999999999},"last":8.0310000000000006}]},{"osd":5,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3560000000000001,"15min":1.6679999999999999},"min":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.63300000000000001},"max":{"1min":1.724,"5min":6.9329999999999998,"15min":81.069999999999993},"last":2.327},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2729999999999999,"15min":1.5880000000000001},"min":{"1min":0.74399999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"max":{"1min":1.603,"5min":6.6399999999999997,"15min":80.777000000000001},"last":1.736}]},{"osd":6,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3700000000000001,"15min":1.2929999999999999},"min":{"1min":0.70599999999999996,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6970000000000001,"5min":4.944,"15min":5.7060000000000004},"last":2.6539999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.5309999999999999,"15min":1.4239999999999999},"min":{"1min":0.876,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8600000000000001,"5min":10.449,"15min":10.449},"last":2.5649999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3620000000000001,"15min":1.337},"min":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66000000000000003},"max":{"1min":1.6890000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":1.387},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.522,"15min":1.4370000000000001},"min":{"1min":0.94699999999999995,"5min":0.81799999999999995,"15min":0.79300000000000004},"max":{"1min":2.073,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":2.5049999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5880000000000001,"15min":1.9370000000000001},"min":{"1min":1.024,"5min":0.94999999999999996,"15min":0.82199999999999995},"max":{"1min":1.9850000000000001,"5min":4.2190000000000003,"15min":80.457999999999998},"last":2.4020000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.6279999999999999,"15min":1.9750000000000001},"min":{"1min":1.05,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8180000000000001,"5min":8.1500000000000004,"15min":82.094999999999999},"last":1.867}]},{"osd":9,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6419999999999999,"15min":1.659},"min":{"1min":1.093,"5min":0.98599999999999999,"15min":0.94199999999999995},"max":{"1min":2.0009999999999999,"5min":6.048,"15min":7.6509999999999998},"last":3.077},{"interface":"front","average":{"1min":1.611,"5min":1.6919999999999999,"15min":1.7290000000000001},"min":{"1min":1.3320000000000001,"5min":0.90900000000000003,"15min":0.84799999999999998},"max":{"1min":2.1040000000000001,"5min":4.3949999999999996,"15min":7.8940000000000001},"last":2.6419999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":2.0800000000000001,"15min":2.5089999999999999},"min":{"1min":1.2330000000000001,"5min":1.0780000000000001,"15min":1.048},"max":{"1min":6.125,"5min":16.952999999999999,"15min":21.556000000000001},"last":2.7919999999999998},{"interface":"front","average":{"1min":1.671,"5min":1.9450000000000001,"15min":2.508},"min":{"1min":1.321,"5min":1.2470000000000001,"15min":1.1140000000000001},"max":{"1min":2.226,"5min":8.7739999999999991,"15min":22.158999999999999},"last":2.4889999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.766,"15min":2.093},"min":{"1min":1.1259999999999999,"5min":1.0620000000000001,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":8.4969999999999999,"15min":81.783000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.895,"15min":2.153},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":1.117},"max":{"1min":2.198,"5min":7.1210000000000004,"15min":81.853999999999999},"last":2.9390000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444235,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2208680,"kb_used_data":1849696,"kb_used_omap":0,"kb_used_meta":358976,"kb_avail":92163160,"statfs":{"total":96636764160,"available":94375075840,"internally_reserved":0,"allocated":1894088704,"data_stored":1893930171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":367591424},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":2.4350000000000001,"15min":2.5779999999999998},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.325,"5min":28.654,"15min":30.84},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":2.5880000000000001,"15min":2.3799999999999999},"min":{"1min":0.65000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5700000000000001,"5min":28.18,"15min":31.724},"last":1.321}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":8.0199999999999996,"5min":13.227,"15min":8.9049999999999994},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.64700000000000002},"max":{"1min":37.325000000000003,"5min":55.183999999999997,"15min":59.253},"last":1.0589999999999999},{"interface":"front","average":{"1min":8.1029999999999998,"5min":13.624000000000001,"15min":10.289999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.61699999999999999},"max":{"1min":37.371000000000002,"5min":55.234999999999999,"15min":171.99199999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":2.2949999999999999,"15min":2.859},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"max":{"1min":2.302,"5min":19.934999999999999,"15min":31.109000000000002},"last":1.147},{"interface":"front","average":{"1min":1.1160000000000001,"5min":3.956,"15min":3.6259999999999999},"min":{"1min":0.82599999999999996,"5min":0.68000000000000005,"15min":0.67300000000000004},"max":{"1min":1.726,"5min":37.377000000000002,"15min":37.377000000000002},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":3.081,"15min":3.214},"min":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.5670000000000002,"5min":28.321000000000002,"15min":32.130000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.379,"5min":2.5819999999999999,"15min":3.7349999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.5390000000000001,"5min":25.385000000000002,"15min":31.341000000000001},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.0099999999999998,"15min":4.6829999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.66500000000000004},"max":{"1min":2.0329999999999999,"5min":44.808999999999997,"15min":62.055},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":4.758,"15min":4.0759999999999996},"min":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.464,"5min":44.914999999999999,"15min":61.060000000000002},"last":1.4430000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":4.8559999999999999,"15min":4.7000000000000002},"min":{"1min":0.79400000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.9870000000000001,"5min":44.597000000000001,"15min":45.829999999999998},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.76,"5min":6.2519999999999998,"15min":4.7720000000000002},"min":{"1min":0.95899999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":6.4699999999999998,"5min":54.201000000000001,"15min":54.201000000000001},"last":19.754999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":7.1989999999999998,"15min":5.367},"min":{"1min":1.0309999999999999,"5min":0.878,"15min":0.878},"max":{"1min":2.5659999999999998,"5min":44.716000000000001,"15min":44.716000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.847,"5min":4.8700000000000001,"15min":4.8129999999999997},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.7489999999999997,"5min":44.753,"15min":44.753},"last":1.4890000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":5.1970000000000001,"15min":4.1280000000000001},"min":{"1min":1.032,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.669,"5min":44.639000000000003,"15min":44.639000000000003},"last":19.457999999999998},{"interface":"front","average":{"1min":1.6719999999999999,"5min":6.0030000000000001,"15min":5.2770000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.423,"5min":45.015999999999998,"15min":45.015999999999998},"last":19.559999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":8.5739999999999998,"15min":7.6470000000000002},"min":{"1min":1.147,"5min":1.147,"15min":1.1339999999999999},"max":{"1min":4.0099999999999998,"5min":44.954000000000001,"15min":45.936},"last":19.484000000000002},{"interface":"front","average":{"1min":1.8169999999999999,"5min":6.6239999999999997,"15min":6.7519999999999998},"min":{"1min":1.1399999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.0309999999999997,"5min":44.784999999999997,"15min":50.340000000000003},"last":19.596}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":6.0190000000000001,"15min":5.4640000000000004},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":4.8710000000000004,"5min":44.881999999999998,"15min":44.881999999999998},"last":19.422999999999998},{"interface":"front","average":{"1min":1.665,"5min":8.1489999999999991,"15min":6.048},"min":{"1min":1.208,"5min":1.093,"15min":1.093},"max":{"1min":2.2919999999999998,"5min":53.826999999999998,"15min":53.826999999999998},"last":19.620999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444235,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1108008,"kb_used_data":917792,"kb_used_omap":0,"kb_used_meta":190208,"kb_avail":93263832,"statfs":{"total":96636764160,"available":95502163968,"internally_reserved":0,"allocated":939819008,"data_stored":939660475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":194772992},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.101,"15min":1.0580000000000001},"min":{"1min":0.65400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2929999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.6859999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.089,"15min":1.0549999999999999},"min":{"1min":0.65100000000000002,"5min":0.62,"15min":0.60699999999999998},"max":{"1min":1.234,"5min":5.665,"15min":5.665},"last":0.93200000000000005}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":7.9820000000000002,"15min":6.2060000000000004},"min":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.63500000000000001},"max":{"1min":14.426,"5min":37.024999999999999,"15min":95.546999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":3.0659999999999998,"5min":7.8879999999999999,"15min":5.9630000000000001},"min":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":14.476000000000001,"5min":38.518000000000001,"15min":94.667000000000002},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.613,"15min":1.4990000000000001},"min":{"1min":0.68500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.647,"5min":22.68,"15min":22.68},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.552,"15min":1.371},"min":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.64400000000000002},"max":{"1min":1.3700000000000001,"5min":28.699999999999999,"15min":28.699999999999999},"last":1.0649999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":3.1179999999999999,"15min":4.0350000000000001},"min":{"1min":0.90500000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.992,"5min":19.047999999999998,"15min":92.614999999999995},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.286,"5min":3.0830000000000002,"15min":4.2560000000000002},"min":{"1min":1.0780000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.657,"5min":18.266999999999999,"15min":93.894000000000005},"last":1.706}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.6679999999999999,"15min":1.657},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.629},"max":{"1min":2.1389999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":1.8260000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":1.026,"5min":1.006,"15min":0.91000000000000003},"max":{"1min":1.788,"5min":10.125,"15min":10.125},"last":1.8580000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.593,"15min":1.601},"min":{"1min":0.96999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7070000000000001,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":1.506},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.841,"15min":1.867},"min":{"1min":1.161,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.2559999999999998,"5min":10.981999999999999,"15min":10.981999999999999},"last":2.0910000000000002}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1349999999999998},"min":{"1min":1.302,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.3279999999999998,"5min":9.8010000000000002,"15min":45.292999999999999},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.623,"5min":2.0409999999999999,"15min":2.2389999999999999},"min":{"1min":1.3340000000000001,"5min":1.1830000000000001,"15min":1.0660000000000001},"max":{"1min":1.966,"5min":10.221,"15min":45.390000000000001},"last":2.1970000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.9590000000000001,"15min":2.0880000000000001},"min":{"1min":1.3720000000000001,"5min":1.3180000000000001,"15min":1.202},"max":{"1min":2.056,"5min":9.9979999999999993,"15min":45.686999999999998},"last":1.99},{"interface":"front","average":{"1min":1.395,"5min":1.774,"15min":1.758},"min":{"1min":1.169,"5min":1.0760000000000001,"15min":0.93799999999999994},"max":{"1min":1.7509999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":1.599}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.9790000000000001,"15min":3.4340000000000002},"min":{"1min":1.276,"5min":1.153,"15min":1.103},"max":{"1min":2.5539999999999998,"5min":8.7330000000000005,"15min":96.786000000000001},"last":5.2679999999999998},{"interface":"front","average":{"1min":1.661,"5min":2.105,"15min":3.5550000000000002},"min":{"1min":1.331,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.3999999999999999,"5min":10.847,"15min":95.569999999999993},"last":5.6849999999999996}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":2.1509999999999998,"15min":2.2490000000000001},"min":{"1min":1.419,"5min":1.3680000000000001,"15min":1.1990000000000001},"max":{"1min":2.1859999999999999,"5min":15.747,"15min":45.524000000000001},"last":2.1190000000000002},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.9650000000000001,"15min":2.137},"min":{"1min":1.3560000000000001,"5min":1.1679999999999999,"15min":1.163},"max":{"1min":1.8740000000000001,"5min":9.843,"15min":45.317999999999998},"last":1.665}]}]}]}} 2020-11-20T11:46:06.603 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.604 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.604 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.605 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.605 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.605 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.606 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.606 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.606 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T11:29:11.234877+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=11, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.607 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.607 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.607 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.608 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.608 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.608 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.609 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.609 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.609 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.610 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.610 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.610 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:06.610 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T11:46:26.612 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:46:26.851 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.845+0000 7fac353fe700 1 Processor -- start 2020-11-20T11:46:26.853 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.850+0000 7fac353fe700 1 -- start start 2020-11-20T11:46:26.854 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac353fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac300bfea0 0x7fac300c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac353fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac300ba2e0 0x7fac300bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac353fe700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300bc220 con 0x7fac30151b70 2020-11-20T11:46:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac353fe700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300bc4c0 con 0x7fac300ba2e0 2020-11-20T11:46:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac353fe700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300bc020 con 0x7fac300bfea0 2020-11-20T11:46:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac300ba2e0 0x7fac300bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac300ba2e0 0x7fac300bbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.105:60798/0 (socket says 172.21.15.105:60798) 2020-11-20T11:46:26.856 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 -- 172.21.15.105:0/2163343521 learned_addr learned my addr 172.21.15.105:0/2163343521 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 -- 172.21.15.105:0/2163343521 >> v2:172.21.15.105:3300/0 conn(0x7fac300bfea0 msgr2=0x7fac300c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 --2- 172.21.15.105:0/2163343521 >> v2:172.21.15.105:3300/0 conn(0x7fac300bfea0 0x7fac300c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 -- 172.21.15.105:0/2163343521 >> v1:172.21.15.105:6789/0 conn(0x7fac30151b70 legacy=0x7fac30064fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:46:26.857 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.852+0000 7fac2f7fe700 1 -- 172.21.15.105:0/2163343521 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3014ddc0 con 0x7fac300ba2e0 2020-11-20T11:46:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.853+0000 7fac2f7fe700 1 --2- 172.21.15.105:0/2163343521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac300ba2e0 0x7fac300bbb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fac30061c80 tx=0x7fac20006eb0).ready entity=mon.1 client_cookie=54fdf891879dac56 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.854+0000 7fac2effd700 1 -- 172.21.15.105:0/2163343521 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20009920 con 0x7fac300ba2e0 2020-11-20T11:46:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.854+0000 7fac2effd700 1 -- 172.21.15.105:0/2163343521 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20009a80 con 0x7fac300ba2e0 2020-11-20T11:46:26.858 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.854+0000 7fac2effd700 1 -- 172.21.15.105:0/2163343521 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20009e00 con 0x7fac300ba2e0 2020-11-20T11:46:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.855+0000 7fac353fe700 1 -- 172.21.15.105:0/2163343521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac300ba2e0 msgr2=0x7fac300bbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:26.859 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.855+0000 7fac353fe700 1 --2- 172.21.15.105:0/2163343521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac300ba2e0 0x7fac300bbb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fac30061c80 tx=0x7fac20006eb0).stop 2020-11-20T11:46:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 -- 172.21.15.105:0/2163343521 shutdown_connections 2020-11-20T11:46:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 --2- 172.21.15.105:0/2163343521 >> v2:172.21.15.105:3300/0 conn(0x7fac300bfea0 0x7fac300c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:46:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 --2- 172.21.15.105:0/2163343521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac300ba2e0 0x7fac300bbb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 -- 172.21.15.105:0/2163343521 >> 172.21.15.105:0/2163343521 conn(0x7fac30025a60 msgr2=0x7fac30025e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 -- 172.21.15.105:0/2163343521 shutdown_connections 2020-11-20T11:46:26.862 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.858+0000 7fac353fe700 1 -- 172.21.15.105:0/2163343521 wait complete. 2020-11-20T11:46:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.860+0000 7fac353fe700 1 Processor -- start 2020-11-20T11:46:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.860+0000 7fac353fe700 1 -- start start 2020-11-20T11:46:26.865 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac300ba2e0 0x7fac300c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.865 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.865 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30151b70 0x7fac3015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.866 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30139930 con 0x7fac300ba2e0 2020-11-20T11:46:26.866 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300c3a20 con 0x7fac30151b70 2020-11-20T11:46:26.866 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac353fe700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300c3cc0 con 0x7fac300bfea0 2020-11-20T11:46:26.866 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac2f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:26.866 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac2f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42674/0 (socket says 172.21.15.105:42674) 2020-11-20T11:46:26.867 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.861+0000 7fac2f7fe700 1 -- 172.21.15.105:0/1342753063 learned_addr learned my addr 172.21.15.105:0/1342753063 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:26.867 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac34bfd700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30151b70 0x7fac3015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:26.867 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2ffff700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac300ba2e0 0x7fac300c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:26.867 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 -- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30151b70 msgr2=0x7fac3015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:26.867 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30151b70 0x7fac3015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 -- 172.21.15.105:0/1342753063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac300ba2e0 msgr2=0x7fac300c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac300ba2e0 0x7fac300c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 -- 172.21.15.105:0/1342753063 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300c3f60 con 0x7fac300bfea0 2020-11-20T11:46:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac2f7fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fac20000dd0 tx=0x7fac20015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20011dd0 con 0x7fac300bfea0 2020-11-20T11:46:26.869 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.862+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2001e460 con 0x7fac300bfea0 2020-11-20T11:46:26.869 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.863+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2001e800 con 0x7fac300bfea0 2020-11-20T11:46:26.870 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.863+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac30138a60 con 0x7fac300bfea0 2020-11-20T11:46:26.870 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.863+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30138fa0 con 0x7fac300bfea0 2020-11-20T11:46:26.870 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.864+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3005ca10 con 0x7fac300bfea0 2020-11-20T11:46:26.879 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.875+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fac2001a040 con 0x7fac300bfea0 2020-11-20T11:46:26.879 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.876+0000 7fac27fff700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 0x7fac0c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:26.879 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.876+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fac200a4320 con 0x7fac300bfea0 2020-11-20T11:46:26.879 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.876+0000 7fac2ffff700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 0x7fac0c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:26.880 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.877+0000 7fac2ffff700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 0x7fac0c082af0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fac30159520 tx=0x7fac18008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:26.885 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:26.882+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fac20078cb0 con 0x7fac300bfea0 2020-11-20T11:46:27.114 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.111+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac301391a0 con 0x7fac0c080630 2020-11-20T11:46:27.124 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.119+0000 7fac27fff700 1 -- 172.21.15.105:0/1342753063 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+150403 (secure 0 0 0) 0x7fac1800be90 con 0x7fac0c080630 2020-11-20T11:46:27.124 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:46:27.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 msgr2=0x7fac0c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:27.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 0x7fac0c082af0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fac30159520 tx=0x7fac18008040).stop 2020-11-20T11:46:27.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 msgr2=0x7fac30139440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:27.126 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fac20000dd0 tx=0x7fac20015000).stop 2020-11-20T11:46:27.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 shutdown_connections 2020-11-20T11:46:27.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30151b70 0x7fac3015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:27.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac300ba2e0 0x7fac300c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:27.127 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7fac0c080630 0x7fac0c082af0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:27.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 --2- 172.21.15.105:0/1342753063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac300bfea0 0x7fac30139440 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:27.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 >> 172.21.15.105:0/1342753063 conn(0x7fac30025a60 msgr2=0x7fac30067090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:27.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 shutdown_connections 2020-11-20T11:46:27.128 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:27.122+0000 7fac353fe700 1 -- 172.21.15.105:0/1342753063 wait complete. 2020-11-20T11:46:27.128 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:46:27.136 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":534,"stamp":"2020-11-20T11:46:25.466873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2047095956,"num_objects":514,"num_object_clones":0,"num_object_copies":2000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":287729,"num_write_kb":14242168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17103,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82387,"ondisk_log_size":82387,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":7511544,"kb_used_data":4487128,"kb_used_omap":0,"kb_used_meta":3012032,"kb_avail":1124950536,"statfs":{"total":1159641169920,"available":1151949348864,"internally_reserved":0,"allocated":4594819072,"data_stored":4592853484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3084320768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,4,1,5,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":174,"apply_latency_ms":174,"commit_latency_ns":174000000,"apply_latency_ns":174000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3275751424,"num_objects":-781,"num_object_clones":0,"num_object_copies":-3124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12393,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"4.2","version":"28'15479","reported_seq":"15493","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:23.485243+0000","last_change":"2020-11-20T11:46:23.485322+0000","last_active":"2020-11-20T11:46:23.485243+0000","last_peered":"2020-11-20T11:46:23.485243+0000","last_clean":"2020-11-20T11:46:23.485243+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:46:23.485243+0000","last_undegraded":"2020-11-20T11:46:23.485243+0000","last_fullsized":"2020-11-20T11:46:23.485243+0000","mapping_epoch":26,"log_start":"28'5417","ondisk_log_start":"28'5417","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15479","last_scrub_stamp":"2020-11-20T11:46:23.485238+0000","last_deep_scrub":"28'15479","last_deep_scrub_stamp":"2020-11-20T11:46:23.485238+0000","last_clean_scrub_stamp":"2020-11-20T11:46:23.485238+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36246,"num_write_kb":1834562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:16.885620+0000","last_change":"2020-11-20T11:46:16.885708+0000","last_active":"2020-11-20T11:46:16.885620+0000","last_peered":"2020-11-20T11:46:16.885620+0000","last_clean":"2020-11-20T11:46:16.885620+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:46:16.885620+0000","last_undegraded":"2020-11-20T11:46:16.885620+0000","last_fullsized":"2020-11-20T11:46:16.885620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:16.885611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:16.885611+0000","last_clean_scrub_stamp":"2020-11-20T11:46:16.885611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'34","reported_seq":"49","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:16.496661+0000","last_change":"2020-11-20T11:46:16.496661+0000","last_active":"2020-11-20T11:46:16.496661+0000","last_peered":"2020-11-20T11:46:16.496661+0000","last_clean":"2020-11-20T11:46:16.496661+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:46:16.496661+0000","last_undegraded":"2020-11-20T11:46:16.496661+0000","last_fullsized":"2020-11-20T11:46:16.496661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2020-11-20T11:46:16.496557+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2020-11-20T11:46:16.496557+0000","last_clean_scrub_stamp":"2020-11-20T11:46:16.496557+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"28'14340","reported_seq":"14351","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:22.721415+0000","last_change":"2020-11-20T11:29:31.798351+0000","last_active":"2020-11-20T11:46:22.721415+0000","last_peered":"2020-11-20T11:46:22.721415+0000","last_clean":"2020-11-20T11:46:22.721415+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:46:22.721415+0000","last_undegraded":"2020-11-20T11:46:22.721415+0000","last_fullsized":"2020-11-20T11:46:22.721415+0000","mapping_epoch":26,"log_start":"28'4274","ondisk_log_start":"28'4274","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10066,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34388,"num_write_kb":1663140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:00.879051+0000","last_change":"2020-11-20T11:46:00.879131+0000","last_active":"2020-11-20T11:46:00.879051+0000","last_peered":"2020-11-20T11:46:00.879051+0000","last_clean":"2020-11-20T11:46:00.879051+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:46:00.879051+0000","last_undegraded":"2020-11-20T11:46:00.879051+0000","last_fullsized":"2020-11-20T11:46:00.879051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_clean_scrub_stamp":"2020-11-20T11:46:00.879043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'1051","reported_seq":"1065","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.125071+0000","last_change":"2020-11-20T11:45:59.125193+0000","last_active":"2020-11-20T11:45:59.125071+0000","last_peered":"2020-11-20T11:45:59.125071+0000","last_clean":"2020-11-20T11:45:59.125071+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:45:59.125071+0000","last_undegraded":"2020-11-20T11:45:59.125071+0000","last_fullsized":"2020-11-20T11:45:59.125071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1051","last_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_deep_scrub":"28'1051","last_deep_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.125062+0000","log_size":1051,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4421052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":4629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"28'14308","reported_seq":"14319","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:22.680696+0000","last_change":"2020-11-20T11:29:31.800906+0000","last_active":"2020-11-20T11:46:22.680696+0000","last_peered":"2020-11-20T11:46:22.680696+0000","last_clean":"2020-11-20T11:46:22.680696+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:46:22.680696+0000","last_undegraded":"2020-11-20T11:46:22.680696+0000","last_fullsized":"2020-11-20T11:46:22.680696+0000","mapping_epoch":26,"log_start":"28'4237","ondisk_log_start":"28'4237","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10071,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33850,"num_write_kb":1743294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.274613+0000","last_change":"2020-11-20T11:46:15.274721+0000","last_active":"2020-11-20T11:46:15.274613+0000","last_peered":"2020-11-20T11:46:15.274613+0000","last_clean":"2020-11-20T11:46:15.274613+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:46:15.274613+0000","last_undegraded":"2020-11-20T11:46:15.274613+0000","last_fullsized":"2020-11-20T11:46:15.274613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.274604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.274604+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.274604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'18","reported_seq":"33","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:01.615821+0000","last_change":"2020-11-20T11:46:01.615821+0000","last_active":"2020-11-20T11:46:01.615821+0000","last_peered":"2020-11-20T11:46:01.615821+0000","last_clean":"2020-11-20T11:46:01.615821+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:46:01.615821+0000","last_undegraded":"2020-11-20T11:46:01.615821+0000","last_fullsized":"2020-11-20T11:46:01.615821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_clean_scrub_stamp":"2020-11-20T11:46:01.615737+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'14759","reported_seq":"14770","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:22.214204+0000","last_change":"2020-11-20T11:29:31.810409+0000","last_active":"2020-11-20T11:46:22.214204+0000","last_peered":"2020-11-20T11:46:22.214204+0000","last_clean":"2020-11-20T11:46:22.214204+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:46:22.214204+0000","last_undegraded":"2020-11-20T11:46:22.214204+0000","last_fullsized":"2020-11-20T11:46:22.214204+0000","mapping_epoch":26,"log_start":"28'4732","ondisk_log_start":"28'4732","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10027,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35079,"num_write_kb":1743800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:29:31.806853+0000","last_change":"2020-11-20T11:29:25.810118+0000","last_active":"2020-11-20T11:29:31.806853+0000","last_peered":"2020-11-20T11:29:31.806853+0000","last_clean":"2020-11-20T11:29:31.806853+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:29:31.806853+0000","last_undegraded":"2020-11-20T11:29:31.806853+0000","last_fullsized":"2020-11-20T11:29:31.806853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:24.749283+0000","last_clean_scrub_stamp":"2020-11-20T11:29:24.749283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'6","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:14.471628+0000","last_change":"2020-11-20T11:46:14.471715+0000","last_active":"2020-11-20T11:46:14.471628+0000","last_peered":"2020-11-20T11:46:14.471628+0000","last_clean":"2020-11-20T11:46:14.471628+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:46:14.471628+0000","last_undegraded":"2020-11-20T11:46:14.471628+0000","last_fullsized":"2020-11-20T11:46:14.471628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2020-11-20T11:46:14.471619+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2020-11-20T11:46:14.471619+0000","last_clean_scrub_stamp":"2020-11-20T11:46:14.471619+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12393,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:30:47.213189+0000","last_change":"2020-11-20T11:29:28.947687+0000","last_active":"2020-11-20T11:30:47.213189+0000","last_peered":"2020-11-20T11:30:47.213189+0000","last_clean":"2020-11-20T11:30:47.213189+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:30:47.213189+0000","last_undegraded":"2020-11-20T11:30:47.213189+0000","last_fullsized":"2020-11-20T11:30:47.213189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'14635","reported_seq":"14649","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:22.904420+0000","last_change":"2020-11-20T11:46:13.657955+0000","last_active":"2020-11-20T11:46:22.904420+0000","last_peered":"2020-11-20T11:46:22.904420+0000","last_clean":"2020-11-20T11:46:22.904420+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:46:22.904420+0000","last_undegraded":"2020-11-20T11:46:22.904420+0000","last_fullsized":"2020-11-20T11:46:22.904420+0000","mapping_epoch":26,"log_start":"28'4550","ondisk_log_start":"28'4550","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14479","last_scrub_stamp":"2020-11-20T11:46:13.657891+0000","last_deep_scrub":"28'14479","last_deep_scrub_stamp":"2020-11-20T11:46:13.657891+0000","last_clean_scrub_stamp":"2020-11-20T11:46:13.657891+0000","log_size":10085,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34343,"num_write_kb":1724632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.924469+0000","last_change":"2020-11-20T11:45:59.924526+0000","last_active":"2020-11-20T11:45:59.924469+0000","last_peered":"2020-11-20T11:45:59.924469+0000","last_clean":"2020-11-20T11:45:59.924469+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:45:59.924469+0000","last_undegraded":"2020-11-20T11:45:59.924469+0000","last_fullsized":"2020-11-20T11:45:59.924469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.924465+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'66","reported_seq":"105","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:17.903488+0000","last_change":"2020-11-20T11:46:17.903583+0000","last_active":"2020-11-20T11:46:17.903488+0000","last_peered":"2020-11-20T11:46:17.903488+0000","last_clean":"2020-11-20T11:46:17.903488+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:46:17.903488+0000","last_undegraded":"2020-11-20T11:46:17.903488+0000","last_fullsized":"2020-11-20T11:46:17.903488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2020-11-20T11:46:17.903480+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2020-11-20T11:46:17.903480+0000","last_clean_scrub_stamp":"2020-11-20T11:46:17.903480+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":68,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'15961","reported_seq":"15972","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:23.454510+0000","last_change":"2020-11-20T11:29:31.810862+0000","last_active":"2020-11-20T11:46:23.454510+0000","last_peered":"2020-11-20T11:46:23.454510+0000","last_clean":"2020-11-20T11:46:23.454510+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:46:23.454510+0000","last_undegraded":"2020-11-20T11:46:23.454510+0000","last_fullsized":"2020-11-20T11:46:23.454510+0000","mapping_epoch":26,"log_start":"28'5897","ondisk_log_start":"28'5897","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10064,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37620,"num_write_kb":1831709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.356411+0000","last_change":"2020-11-20T11:46:02.356473+0000","last_active":"2020-11-20T11:46:02.356411+0000","last_peered":"2020-11-20T11:46:02.356411+0000","last_clean":"2020-11-20T11:46:02.356411+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:46:02.356411+0000","last_undegraded":"2020-11-20T11:46:02.356411+0000","last_fullsized":"2020-11-20T11:46:02.356411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:02.356408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:02.356408+0000","last_clean_scrub_stamp":"2020-11-20T11:46:02.356408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'558","reported_seq":"570","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.324727+0000","last_change":"2020-11-20T11:29:28.781951+0000","last_active":"2020-11-20T11:45:49.324727+0000","last_peered":"2020-11-20T11:45:49.324727+0000","last_clean":"2020-11-20T11:45:49.324727+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:45:49.324727+0000","last_undegraded":"2020-11-20T11:45:49.324727+0000","last_fullsized":"2020-11-20T11:45:49.324727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":558,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'15158","reported_seq":"15169","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:22.562845+0000","last_change":"2020-11-20T11:29:31.810620+0000","last_active":"2020-11-20T11:46:22.562845+0000","last_peered":"2020-11-20T11:46:22.562845+0000","last_clean":"2020-11-20T11:46:22.562845+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:46:22.562845+0000","last_undegraded":"2020-11-20T11:46:22.562845+0000","last_fullsized":"2020-11-20T11:46:22.562845+0000","mapping_epoch":26,"log_start":"28'5092","ondisk_log_start":"28'5092","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:30.782930+0000","last_clean_scrub_stamp":"2020-11-20T11:29:30.782930+0000","log_size":10066,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36787,"num_write_kb":1763006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'11","reported_seq":"23","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:49.952753+0000","last_change":"2020-11-20T11:29:28.835613+0000","last_active":"2020-11-20T11:45:49.952753+0000","last_peered":"2020-11-20T11:45:49.952753+0000","last_clean":"2020-11-20T11:45:49.952753+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:45:49.952753+0000","last_undegraded":"2020-11-20T11:45:49.952753+0000","last_fullsized":"2020-11-20T11:45:49.952753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:29:27.763786+0000","last_clean_scrub_stamp":"2020-11-20T11:29:27.763786+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.131110+0000","last_change":"2020-11-20T11:46:15.131199+0000","last_active":"2020-11-20T11:46:15.131110+0000","last_peered":"2020-11-20T11:46:15.131110+0000","last_clean":"2020-11-20T11:46:15.131110+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:46:15.131110+0000","last_undegraded":"2020-11-20T11:46:15.131110+0000","last_fullsized":"2020-11-20T11:46:15.131110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.131101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.131101+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.131101+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'15864","reported_seq":"15876","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:24.083903+0000","last_change":"2020-11-20T11:46:15.728306+0000","last_active":"2020-11-20T11:46:24.083903+0000","last_peered":"2020-11-20T11:46:24.083903+0000","last_clean":"2020-11-20T11:46:24.083903+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:46:24.083903+0000","last_undegraded":"2020-11-20T11:46:24.083903+0000","last_fullsized":"2020-11-20T11:46:24.083903+0000","mapping_epoch":26,"log_start":"28'5804","ondisk_log_start":"28'5804","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15729","last_scrub_stamp":"2020-11-20T11:46:15.728249+0000","last_deep_scrub":"28'15729","last_deep_scrub_stamp":"2020-11-20T11:46:15.728249+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.728249+0000","log_size":10060,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37349,"num_write_kb":1928765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.417256+0000","last_change":"2020-11-20T11:46:15.417328+0000","last_active":"2020-11-20T11:46:15.417256+0000","last_peered":"2020-11-20T11:46:15.417256+0000","last_clean":"2020-11-20T11:46:15.417256+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:46:15.417256+0000","last_undegraded":"2020-11-20T11:46:15.417256+0000","last_fullsized":"2020-11-20T11:46:15.417256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.417251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.417251+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.417251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'138","reported_seq":"153","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:05.819985+0000","last_change":"2020-11-20T11:46:05.820075+0000","last_active":"2020-11-20T11:46:05.819985+0000","last_peered":"2020-11-20T11:46:05.819985+0000","last_clean":"2020-11-20T11:46:05.819985+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:46:05.819985+0000","last_undegraded":"2020-11-20T11:46:05.819985+0000","last_fullsized":"2020-11-20T11:46:05.819985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'138","last_scrub_stamp":"2020-11-20T11:46:05.819978+0000","last_deep_scrub":"28'138","last_deep_scrub_stamp":"2020-11-20T11:46:05.819978+0000","last_clean_scrub_stamp":"2020-11-20T11:46:05.819978+0000","log_size":138,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":2038431744,"num_objects":486,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285662,"num_write_kb":14232908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4288675840,"data_stored":4288675840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80501,"ondisk_log_size":80501,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8664212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":2064,"num_write_kb":9245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17391616,"data_stored":17328424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1880,"ondisk_log_size":1880,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12393,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444240,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489048,"kb_used_data":301392,"kb_used_omap":0,"kb_used_meta":187648,"kb_avail":93882792,"statfs":{"total":96636764160,"available":96135979008,"internally_reserved":0,"allocated":308625408,"data_stored":308465201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":192151552},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.61599999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3029999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.034,"15min":1.1519999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3919999999999999,"5min":2.8980000000000001,"15min":6.468},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.349,"15min":1.446},"min":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.621},"max":{"1min":1.655,"5min":12.504,"15min":12.504},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.1579999999999999,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.1339999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.96899999999999997,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.59899999999999998},"max":{"1min":1.2749999999999999,"5min":4.5279999999999996,"15min":4.5730000000000004},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.381,"15min":1.498},"min":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.8480000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":4.8010000000000002,"15min":4.1719999999999997},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.8979999999999999,"5min":52.670000000000002,"15min":52.670000000000002},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.181,"5min":5.0209999999999999,"15min":4.2240000000000002},"min":{"1min":0.81000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.839,"5min":52.637,"15min":52.637},"last":2.5059999999999998}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.522},"min":{"1min":0.97799999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2000000000000002,"5min":4.2939999999999996,"15min":5.0599999999999996},"last":1.639},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2729999999999999,"15min":1.4530000000000001},"min":{"1min":0.95799999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9410000000000001,"5min":5.2530000000000001,"15min":9.0850000000000009},"last":2.7410000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.7589999999999999,"15min":1.8440000000000001},"min":{"1min":1.2110000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.6470000000000002,"5min":5.9199999999999999,"15min":5.9199999999999999},"last":34.945},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6850000000000001,"15min":1.7509999999999999},"min":{"1min":1.29,"5min":1.034,"15min":0.98699999999999999},"max":{"1min":4.6829999999999998,"5min":5.8739999999999997,"15min":6.9279999999999999},"last":34.874000000000002}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5640000000000001,"15min":1.9119999999999999},"min":{"1min":1.0600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0960000000000001,"5min":4.8579999999999997,"15min":69.603999999999999},"last":2.3820000000000001},{"interface":"front","average":{"1min":1.77,"5min":1.7430000000000001,"15min":2.077},"min":{"1min":1.2430000000000001,"5min":1.151,"15min":1.151},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":66.614999999999995},"last":1.9970000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.641,"15min":1.823},"min":{"1min":1.1419999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.242,"5min":4.9800000000000004,"15min":6.2759999999999998},"last":2.8610000000000002},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.7909999999999999,"15min":1.98},"min":{"1min":1.2989999999999999,"5min":1.2230000000000001,"15min":1.208},"max":{"1min":5.2910000000000004,"5min":5.2910000000000004,"15min":5.4790000000000001},"last":2.3490000000000002}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.9610000000000001,"15min":2.0459999999999998},"min":{"1min":1.403,"5min":1.3540000000000001,"15min":1.218},"max":{"1min":5.3650000000000002,"5min":6.4669999999999996,"15min":6.6299999999999999},"last":2.113},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.74,"15min":1.7689999999999999},"min":{"1min":1.204,"5min":1.139,"15min":1.0580000000000001},"max":{"1min":5.1509999999999998,"5min":5.2080000000000002,"15min":5.2080000000000002},"last":1.7549999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.905,"15min":2.8690000000000002},"min":{"1min":1.2090000000000001,"5min":1.085,"15min":1.085},"max":{"1min":3.7410000000000001,"5min":7.0149999999999997,"15min":34.558},"last":2.6230000000000002},{"interface":"front","average":{"1min":2.004,"5min":2.0249999999999999,"15min":2.9969999999999999},"min":{"1min":1.486,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4290000000000003,"5min":6.9260000000000002,"15min":33.133000000000003},"last":2.2309999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":645800,"kb_used_data":362784,"kb_used_omap":0,"kb_used_meta":283008,"kb_avail":93726040,"statfs":{"total":96636764160,"available":95975464960,"internally_reserved":0,"allocated":371490816,"data_stored":371332283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":289800192},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.2729999999999997,"5min":9.9610000000000003,"15min":7.29},"min":{"1min":0.71899999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":23.876999999999999,"5min":75.784000000000006,"15min":75.784000000000006},"last":31.934000000000001},{"interface":"front","average":{"1min":6.9729999999999999,"5min":10.032999999999999,"15min":7.5670000000000002},"min":{"1min":0.76300000000000001,"5min":0.63,"15min":0.60099999999999998},"max":{"1min":24.201000000000001,"5min":75.831000000000003,"15min":75.831000000000003},"last":32.610999999999997}]},{"osd":2,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.387,"15min":1.7370000000000001},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.57199999999999995},"max":{"1min":2.3650000000000002,"5min":20.370000000000001,"15min":31.071000000000002},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.4830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.891,"5min":24.312999999999999,"15min":24.312999999999999},"last":0.873}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5129999999999999,"15min":1.782},"min":{"1min":0.88,"5min":0.57099999999999995,"15min":0.54500000000000004},"max":{"1min":3.9740000000000002,"5min":20.204000000000001,"15min":25.420999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.319,"15min":1.708},"min":{"1min":0.72899999999999998,"5min":0.67400000000000004,"15min":0.53500000000000003},"max":{"1min":2.6280000000000001,"5min":2.9380000000000002,"15min":20.030999999999999},"last":0.84899999999999998}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":4.7720000000000002,"15min":5.4279999999999999},"min":{"1min":0.69199999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":25.651,"5min":35.222999999999999,"15min":43.152999999999999},"last":6.6630000000000003},{"interface":"front","average":{"1min":2.8839999999999999,"5min":6.4249999999999998,"15min":6.3109999999999999},"min":{"1min":0.93600000000000005,"5min":0.91100000000000003,"15min":0.84199999999999997},"max":{"1min":25.908999999999999,"5min":44.122,"15min":46.593000000000004},"last":6.4619999999999997}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8799999999999999,"15min":2.3180000000000001},"min":{"1min":0.66600000000000004,"5min":0.66000000000000003,"15min":0.63},"max":{"1min":4.1159999999999997,"5min":26.366,"15min":26.366},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.089,"15min":2.3679999999999999},"min":{"1min":0.83299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.7519999999999998,"5min":40.494,"15min":40.494},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.2160000000000002,"15min":2.2639999999999998},"min":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.59499999999999997},"max":{"1min":2.0209999999999999,"5min":25.873999999999999,"15min":25.873999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.7470000000000001,"5min":2.032,"15min":2.5379999999999998},"min":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":4.2229999999999999,"5min":23.809000000000001,"15min":25.771000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.282,"15min":2.5430000000000001},"min":{"1min":1.129,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.8809999999999998,"5min":23.800000000000001,"15min":24.831},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.4209999999999998,"15min":2.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":2.9329999999999998,"5min":24.748999999999999,"15min":24.748999999999999},"last":0.80000000000000004}]},{"osd":8,"last update":"Fri Nov 20 11:46:00 2020","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":2.504,"15min":2.9009999999999998},"min":{"1min":1.1080000000000001,"5min":0.82099999999999995,"15min":0.80200000000000005},"max":{"1min":26.579000000000001,"5min":26.579000000000001,"15min":26.579000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":3.2040000000000002,"5min":2.6219999999999999,"15min":3.0299999999999998},"min":{"1min":1.1639999999999999,"5min":0.92500000000000004,"15min":0.70499999999999996},"max":{"1min":26.748999999999999,"5min":40.624000000000002,"15min":40.624000000000002},"last":1.214}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":2.7949999999999999,"15min":2.952},"min":{"1min":1.175,"5min":0.90900000000000003,"15min":0.81100000000000005},"max":{"1min":2.4159999999999999,"5min":26.437000000000001,"15min":29.969999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.347,"15min":2.9790000000000001},"min":{"1min":1.1899999999999999,"5min":0.97299999999999998,"15min":0.80100000000000005},"max":{"1min":4.4459999999999997,"5min":25.498999999999999,"15min":29.881},"last":1.173}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":2.2789999999999999,"15min":2.9380000000000002},"min":{"1min":1.427,"5min":1.004,"15min":1.004},"max":{"1min":3.0430000000000001,"5min":22.917000000000002,"15min":30.013999999999999},"last":1.28},{"interface":"front","average":{"1min":1.7909999999999999,"5min":2.641,"15min":3.1320000000000001},"min":{"1min":1.2909999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3290000000000002,"5min":25.626000000000001,"15min":28.550999999999998},"last":1.034}]}]},{"osd":9,"up_from":17,"seq":73014444239,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1009356,"kb_used_data":633348,"kb_used_omap":0,"kb_used_meta":376000,"kb_avail":93362484,"statfs":{"total":96636764160,"available":95603183616,"internally_reserved":0,"allocated":648548352,"data_stored":648383095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":385024000},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":0.93999999999999995},"min":{"1min":0.76000000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.331,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":1.161},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.70899999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.9330000000000001,"5min":5.3170000000000002,"15min":6.7969999999999997},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":8.2119999999999997,"15min":6.3630000000000004},"min":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.65100000000000002},"max":{"1min":16.420999999999999,"5min":37.811999999999998,"15min":114.867},"last":5.3319999999999999},{"interface":"front","average":{"1min":2.7330000000000001,"5min":8.1440000000000001,"15min":6.1429999999999998},"min":{"1min":0.73899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":16.260999999999999,"5min":37.152999999999999,"15min":114.36799999999999},"last":5.2400000000000002}]},{"osd":2,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.248,"15min":1.6040000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7050000000000001,"5min":7.0990000000000002,"15min":53.234000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.3580000000000001,"15min":1.669},"min":{"1min":0.88900000000000001,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.8720000000000001,"5min":5.5919999999999996,"15min":54.753},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.405,"15min":1.3879999999999999},"min":{"1min":0.81299999999999994,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.768,"5min":5.6390000000000002,"15min":7.2080000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.4610000000000001,"15min":1.411},"min":{"1min":1.097,"5min":0.746,"15min":0.746},"max":{"1min":1.899,"5min":7.234,"15min":7.234},"last":1.595}]},{"osd":4,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":4.5919999999999996,"15min":3.927},"min":{"1min":1.246,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0139999999999998,"5min":37.531999999999996,"15min":84.661000000000001},"last":13.531000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":4.6280000000000001,"15min":3.9750000000000001},"min":{"1min":1.0069999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.327,"5min":37.469000000000001,"15min":84.811000000000007},"last":13.728}]},{"osd":5,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":1.804},"min":{"1min":1.012,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0960000000000001,"5min":7.3639999999999999,"15min":53.052},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.702,"15min":1.869},"min":{"1min":1.321,"5min":1.05,"15min":1.0189999999999999},"max":{"1min":2.137,"5min":6.1299999999999999,"15min":53.853000000000002},"last":1.486}]},{"osd":6,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.7330000000000001,"15min":1.706},"min":{"1min":1.1919999999999999,"5min":1.03,"15min":1.03},"max":{"1min":2.0630000000000002,"5min":5.7720000000000002,"15min":7.3410000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.698,"15min":1.7110000000000001},"min":{"1min":1.1719999999999999,"5min":1,"15min":0.84399999999999997},"max":{"1min":2.282,"5min":7.5979999999999999,"15min":9.0199999999999996},"last":1.746}]},{"osd":8,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.869,"15min":2.1190000000000002},"min":{"1min":1.3029999999999999,"5min":1.163,"15min":1.163},"max":{"1min":2.2629999999999999,"5min":7.7619999999999996,"15min":54.600999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.893,"15min":2.2789999999999999},"min":{"1min":1.276,"5min":1.139,"15min":1.139},"max":{"1min":2.1989999999999998,"5min":9.8450000000000006,"15min":55.698},"last":1.4099999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8899999999999999,"15min":2.6320000000000001},"min":{"1min":1.3400000000000001,"5min":1.2430000000000001,"15min":1.2},"max":{"1min":3.1179999999999999,"5min":7.484,"15min":21.552},"last":1.671},{"interface":"front","average":{"1min":1.802,"5min":1.958,"15min":2.5529999999999999},"min":{"1min":1.411,"5min":1.173,"15min":1.0760000000000001},"max":{"1min":3.1389999999999998,"5min":6.9050000000000002,"15min":21.600999999999999},"last":1.353}]},{"osd":11,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.9239999999999999,"15min":2.0880000000000001},"min":{"1min":1.3240000000000001,"5min":1.2290000000000001,"15min":1.157},"max":{"1min":2.468,"5min":6.0499999999999998,"15min":53.317},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.9179999999999999,"15min":2.1309999999999998},"min":{"1min":1.4159999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.23,"5min":7.7270000000000003,"15min":53.140000000000001},"last":1.8140000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444239,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":668344,"kb_used_data":385328,"kb_used_omap":0,"kb_used_meta":283008,"kb_avail":93703496,"statfs":{"total":96636764160,"available":95952379904,"internally_reserved":0,"allocated":394575872,"data_stored":394401758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":289800192},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":1.3009999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":71.022999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98699999999999999,"15min":1.3839999999999999},"min":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.56100000000000005},"max":{"1min":2.827,"5min":6.1589999999999998,"15min":70.582999999999998},"last":1.113}]},{"osd":1,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":7.8869999999999996,"15min":5.6749999999999998},"min":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":9.5350000000000001,"5min":54.277999999999999,"15min":55.158999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":2.2290000000000001,"5min":8.3379999999999992,"15min":5.9969999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":10.224,"5min":54.159999999999997,"15min":55.703000000000003},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.24,"15min":1.391},"min":{"1min":0.68400000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.9950000000000001,"5min":4.9950000000000001,"15min":8.8699999999999992},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2050000000000001,"15min":1.2390000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.624},"max":{"1min":5.0270000000000001,"5min":5.7990000000000004,"15min":6.0810000000000004},"last":0.876}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2989999999999999,"15min":1.7529999999999999},"min":{"1min":0.91100000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1230000000000002,"5min":6.4059999999999997,"15min":70.391000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.8240000000000001},"min":{"1min":1.034,"5min":0.98999999999999999,"15min":0.94999999999999996},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":70.510000000000005},"last":1.0740000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":4.891,"15min":4.5730000000000004},"min":{"1min":1.077,"5min":0.94299999999999995,"15min":0.88300000000000001},"max":{"1min":17.567,"5min":49.796999999999997,"15min":88.828000000000003},"last":6.7990000000000004},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.468,"15min":4.1710000000000003},"min":{"1min":1.016,"5min":0.72499999999999998,"15min":0.69899999999999995},"max":{"1min":17.832999999999998,"5min":49.468000000000004,"15min":88.775999999999996},"last":6.819}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3440000000000001,"15min":1.534},"min":{"1min":0.96399999999999997,"5min":0.84499999999999997,"15min":0.75900000000000001},"max":{"1min":2.0070000000000001,"5min":2.3530000000000002,"15min":8.2010000000000005},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.585,"15min":1.871},"min":{"1min":1.133,"5min":1.0389999999999999,"15min":0.90300000000000002},"max":{"1min":2.4489999999999998,"5min":6.3109999999999999,"15min":19.702999999999999},"last":1.4019999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.8819999999999999,"15min":2.0110000000000001},"min":{"1min":1.202,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2280000000000002,"5min":18.169,"15min":18.169},"last":1.306},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.8,"15min":1.966},"min":{"1min":1.2370000000000001,"5min":1.1439999999999999,"15min":1.125},"max":{"1min":5.9939999999999998,"5min":5.9939999999999998,"15min":9.4499999999999993},"last":1.2470000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.5660000000000001,"15min":1.911},"min":{"1min":1.1060000000000001,"5min":1.034,"15min":1.0029999999999999},"max":{"1min":1.6559999999999999,"5min":7.7770000000000001,"15min":70.606999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.8859999999999999,"15min":2.3140000000000001},"min":{"1min":1.2689999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3370000000000002,"5min":18.033999999999999,"15min":75.585999999999999},"last":1.224}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":2.2549999999999999,"15min":3.2029999999999998},"min":{"1min":1.3360000000000001,"5min":1.2170000000000001,"15min":1.171},"max":{"1min":7.077,"5min":13.571,"15min":73.167000000000002},"last":1.371},{"interface":"front","average":{"1min":1.663,"5min":2.04,"15min":3.0230000000000001},"min":{"1min":1.393,"5min":1.22,"15min":0.90000000000000002},"max":{"1min":3.3119999999999998,"5min":13.545999999999999,"15min":73.046999999999997},"last":1.282}]},{"osd":11,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":2.0579999999999998,"15min":2.242},"min":{"1min":1.29,"5min":1.29,"15min":1.1519999999999999},"max":{"1min":3.762,"5min":18.279,"15min":18.279},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.8149999999999999,"15min":2.0550000000000002},"min":{"1min":1.302,"5min":1.2729999999999999,"15min":1.1699999999999999},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":9.359},"last":1.5069999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444239,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":479536,"kb_used_data":295208,"kb_used_omap":0,"kb_used_meta":184320,"kb_avail":93892304,"statfs":{"total":96636764160,"available":96145719296,"internally_reserved":0,"allocated":302292992,"data_stored":302126842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":188743680},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.1359999999999999},"min":{"1min":0.55100000000000005,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":1.667,"5min":3.9369999999999998,"15min":39.671999999999997},"last":1.115},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":1.1160000000000001},"min":{"1min":0.627,"5min":0.54700000000000004,"15min":0.496},"max":{"1min":2.7589999999999999,"5min":4.21,"15min":36.548000000000002},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":8.4309999999999992,"15min":6.0629999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.61499999999999999},"max":{"1min":17.905999999999999,"5min":51.244999999999997,"15min":115.669},"last":0.74299999999999999},{"interface":"front","average":{"1min":3.5960000000000001,"5min":9.0039999999999996,"15min":6.1980000000000004},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.63500000000000001},"max":{"1min":18.001000000000001,"5min":51.121000000000002,"15min":115.831},"last":1.889}]},{"osd":2,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.421,"15min":1.6279999999999999},"min":{"1min":0.73399999999999999,"5min":0.63800000000000001,"15min":0.46800000000000003},"max":{"1min":3.2810000000000001,"5min":5.8120000000000003,"15min":52.776000000000003},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.355,"15min":1.5609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":6.931,"5min":8.5619999999999994,"15min":52.869999999999997},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2669999999999999,"15min":1.571},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.875,"5min":4.3300000000000001,"15min":39.496000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.49,"5min":1.639,"15min":1.651},"min":{"1min":0.93000000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.9020000000000001,"5min":6.7359999999999998,"15min":37.078000000000003},"last":1.3540000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":4.4820000000000002,"15min":4.7359999999999998},"min":{"1min":0.86499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.0940000000000003,"5min":29.015000000000001,"15min":115.108},"last":1.147},{"interface":"front","average":{"1min":1.611,"5min":4.843,"15min":4.9210000000000003},"min":{"1min":1.04,"5min":0.623,"15min":0.623},"max":{"1min":2.98,"5min":29.611999999999998,"15min":114.602},"last":2.0990000000000002}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5409999999999999,"15min":1.6950000000000001},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.76600000000000001},"max":{"1min":3.1779999999999999,"5min":4.4539999999999997,"15min":37.802},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.772,"15min":1.849},"min":{"1min":1.0189999999999999,"5min":0.89100000000000001,"15min":0.73599999999999999},"max":{"1min":3.1440000000000001,"5min":6.8920000000000003,"15min":37.234000000000002},"last":1.4610000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.476,"15min":1.752},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.60299999999999998},"max":{"1min":3.9750000000000001,"5min":4.9139999999999997,"15min":53.584000000000003},"last":1.28},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.73,"15min":1.9490000000000001},"min":{"1min":1.0429999999999999,"5min":0.84499999999999997,"15min":0.73299999999999998},"max":{"1min":3.0819999999999999,"5min":4.6929999999999996,"15min":52.744},"last":1.728}]},{"osd":9,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.847,"15min":2.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.028,"5min":7.1680000000000001,"15min":35.851999999999997},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.776,"5min":1.6000000000000001,"15min":1.7769999999999999},"min":{"1min":1.069,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":3.8559999999999999,"5min":4.1849999999999996,"15min":36.921999999999997},"last":1.403}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.925,"5min":1.9630000000000001,"15min":2.8180000000000001},"min":{"1min":1.171,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":3.411,"5min":8.5410000000000004,"15min":113.55800000000001},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.9670000000000001,"15min":2.9940000000000002},"min":{"1min":1.103,"5min":1.0700000000000001,"15min":0.85799999999999998},"max":{"1min":3.286,"5min":7.0389999999999997,"15min":117.624},"last":1.675}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.7509999999999999,"15min":1.881},"min":{"1min":1.165,"5min":0.90200000000000002,"15min":0.77400000000000002},"max":{"1min":4.2169999999999996,"5min":4.8390000000000004,"15min":34.616999999999997},"last":1.526},{"interface":"front","average":{"1min":1.877,"5min":1.8859999999999999,"15min":1.986},"min":{"1min":1.3300000000000001,"5min":1.0569999999999999,"15min":0.96199999999999997},"max":{"1min":3.302,"5min":4.9199999999999999,"15min":34.640000000000001},"last":1.8480000000000001}]}]},{"osd":6,"up_from":17,"seq":73014444240,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":980256,"kb_used_data":612696,"kb_used_omap":0,"kb_used_meta":367552,"kb_avail":93391584,"statfs":{"total":96636764160,"available":95632982016,"internally_reserved":0,"allocated":627400704,"data_stored":627232465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376373248},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":7.5279999999999996,"15min":5.0430000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.56299999999999994},"max":{"1min":21.082000000000001,"5min":61.689,"15min":61.689},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.2589999999999999,"5min":6.6390000000000002,"15min":4.8529999999999998},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"max":{"1min":14.728,"5min":44.164000000000001,"15min":44.350999999999999},"last":2.0329999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.3380000000000001,"5min":4.274,"15min":5.242},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0660000000000001,"15min":1.135},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56899999999999995},"max":{"1min":1.601,"5min":6.6609999999999996,"15min":7.4770000000000003},"last":1.04}]},{"osd":3,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.077,"15min":1.0720000000000001},"min":{"1min":0.69299999999999995,"5min":0.627,"15min":0.54000000000000004},"max":{"1min":2.3359999999999999,"5min":4.8360000000000003,"15min":8.2520000000000007},"last":2.1469999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.121},"min":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.60899999999999999},"max":{"1min":2.657,"5min":3.6000000000000001,"15min":5.758},"last":1.103}]},{"osd":4,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":4.1029999999999998,"15min":3.7599999999999998},"min":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.70299999999999996},"max":{"1min":11.422000000000001,"5min":54.881,"15min":54.881},"last":16.997},{"interface":"front","average":{"1min":1.8799999999999999,"5min":4.4870000000000001,"15min":3.931},"min":{"1min":1.008,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":11.472,"5min":54.957999999999998,"15min":54.957999999999998},"last":16.974}]},{"osd":5,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.546,"15min":1.466},"min":{"1min":0.90900000000000003,"5min":0.81000000000000005,"15min":0.60599999999999998},"max":{"1min":2.02,"5min":7.1909999999999998,"15min":7.7300000000000004},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4039999999999999,"15min":1.4450000000000001},"min":{"1min":0.88200000000000001,"5min":0.79200000000000004,"15min":0.72099999999999997},"max":{"1min":2.6859999999999999,"5min":6.4539999999999997,"15min":7.5419999999999998},"last":2.2599999999999998}]},{"osd":7,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.419,"15min":1.4630000000000001},"min":{"1min":0.88600000000000001,"5min":0.84499999999999997,"15min":0.72799999999999998},"max":{"1min":3.0059999999999998,"5min":5.1470000000000002,"15min":8.3800000000000008},"last":2.3820000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5309999999999999,"15min":1.506},"min":{"1min":1.0609999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5339999999999998,"5min":3.8460000000000001,"15min":6.0229999999999997},"last":1.276}]},{"osd":8,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.659,"15min":1.6120000000000001},"min":{"1min":1.155,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8660000000000001,"5min":7.4710000000000001,"15min":7.4710000000000001},"last":1.776},{"interface":"front","average":{"1min":1.51,"5min":1.7909999999999999,"15min":1.8720000000000001},"min":{"1min":1.087,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.911,"5min":10.055999999999999,"15min":10.065},"last":2.484}]},{"osd":9,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.641,"15min":1.6419999999999999},"min":{"1min":1.228,"5min":1.0700000000000001,"15min":1.026},"max":{"1min":3.0059999999999998,"5min":4.4429999999999996,"15min":6.141},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.663,"5min":1.76,"15min":1.679},"min":{"1min":1.252,"5min":0.98899999999999999,"15min":0.82699999999999996},"max":{"1min":2.4630000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":1.891}]},{"osd":10,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":1.8300000000000001,"15min":2.1739999999999999},"min":{"1min":1.288,"5min":1.145,"15min":1.145},"max":{"1min":2.8900000000000001,"5min":5.8179999999999996,"15min":18.337},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.847,"15min":2.2440000000000002},"min":{"1min":1.1040000000000001,"5min":1.0569999999999999,"15min":0.93600000000000005},"max":{"1min":2.1030000000000002,"5min":7.6130000000000004,"15min":23.823},"last":1.9990000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.7130000000000001,"15min":1.7450000000000001},"min":{"1min":1.181,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":3.0720000000000001,"5min":6.6059999999999999,"15min":7.9660000000000002},"last":2.5939999999999999},{"interface":"front","average":{"1min":1.736,"5min":1.845,"15min":1.796},"min":{"1min":1.357,"5min":1.163,"15min":1.119},"max":{"1min":2.7749999999999999,"5min":5.2089999999999996,"15min":6.2640000000000002},"last":1.6719999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444238,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":673648,"kb_used_data":391464,"kb_used_omap":0,"kb_used_meta":282176,"kb_avail":93698192,"statfs":{"total":96636764160,"available":95946948608,"internally_reserved":0,"allocated":400859136,"data_stored":400693054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288948224},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,0,1,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":5.0309999999999997,"15min":3.8330000000000002},"min":{"1min":0.72399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":19.308,"5min":44.576000000000001,"15min":57.322000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":3.7400000000000002,"5min":6.452,"15min":3.722},"min":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.61299999999999999},"max":{"1min":20.452999999999999,"5min":68.094999999999999,"15min":68.094999999999999},"last":0.90600000000000003}]},{"osd":2,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":6.2800000000000002,"15min":4.6559999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"max":{"1min":19.183,"5min":64.680000000000007,"15min":64.680000000000007},"last":1.2130000000000001},{"interface":"front","average":{"1min":3.5950000000000002,"5min":5.2889999999999997,"15min":3.5449999999999999},"min":{"1min":0.66300000000000003,"5min":0.63,"15min":0.63},"max":{"1min":19.152999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.931,"5min":6.6050000000000004,"15min":4.4480000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":20.582000000000001,"5min":68.230000000000004,"15min":68.230000000000004},"last":1.3380000000000001},{"interface":"front","average":{"1min":5.9900000000000002,"5min":7.9950000000000001,"15min":5.2060000000000004},"min":{"1min":0.98999999999999999,"5min":0.85699999999999998,"15min":0.66900000000000004},"max":{"1min":19.859000000000002,"5min":64.951999999999998,"15min":64.951999999999998},"last":1.357}]},{"osd":4,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":17.652999999999999,"15min":11.912000000000001},"min":{"1min":0.87,"5min":0.71499999999999997,"15min":0.66000000000000003},"max":{"1min":20.414000000000001,"5min":68.141000000000005,"15min":68.141000000000005},"last":30.741},{"interface":"front","average":{"1min":6.157,"5min":16.033999999999999,"15min":11.202},"min":{"1min":0.76900000000000002,"5min":0.751,"15min":0.63500000000000001},"max":{"1min":19.780000000000001,"5min":68.816000000000003,"15min":68.816000000000003},"last":30.718}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.2050000000000001,"5min":6.8840000000000003,"15min":4.6050000000000004},"min":{"1min":0.84899999999999998,"5min":0.78500000000000003,"15min":0.76100000000000001},"max":{"1min":19.414000000000001,"5min":64.760999999999996,"15min":64.760999999999996},"last":1.1799999999999999},{"interface":"front","average":{"1min":7.2839999999999998,"5min":9.4559999999999995,"15min":5.976},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.81499999999999995},"max":{"1min":21.158999999999999,"5min":68.406000000000006,"15min":68.406000000000006},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.5800000000000001,"5min":11.606,"15min":7.2130000000000001},"min":{"1min":1.1970000000000001,"5min":0.98699999999999999,"15min":0.73499999999999999},"max":{"1min":20.064,"5min":64.828999999999994,"15min":64.828999999999994},"last":2.0049999999999999},{"interface":"front","average":{"1min":9.4830000000000005,"5min":10.178000000000001,"15min":6.1470000000000002},"min":{"1min":1.1439999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":20.606999999999999,"5min":64.905000000000001,"15min":64.905000000000001},"last":1.3009999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":7.2530000000000001,"5min":9.9480000000000004,"15min":6.2359999999999998},"min":{"1min":1.1020000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":20.085000000000001,"5min":64.637,"15min":64.637},"last":1.5980000000000001},{"interface":"front","average":{"1min":8.6590000000000007,"5min":12.173999999999999,"15min":7.04},"min":{"1min":1.173,"5min":0.98899999999999999,"15min":0.97499999999999998},"max":{"1min":21.402999999999999,"5min":85.200000000000003,"15min":85.200000000000003},"last":4.8230000000000004}]},{"osd":9,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":9.6660000000000004,"5min":13.859999999999999,"15min":7.4699999999999998},"min":{"1min":1.0549999999999999,"5min":1.048,"15min":1.036},"max":{"1min":21.271000000000001,"5min":85.361000000000004,"15min":85.361000000000004},"last":1.748},{"interface":"front","average":{"1min":8.4830000000000005,"5min":11.747,"15min":7.782},"min":{"1min":1.3200000000000001,"5min":1.29,"15min":1.226},"max":{"1min":20.303999999999998,"5min":66.25,"15min":66.25},"last":2.1240000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":10.364000000000001,"5min":12.771000000000001,"15min":9.2509999999999994},"min":{"1min":1.242,"5min":1.181,"15min":1.079},"max":{"1min":20.744,"5min":65.650000000000006,"15min":75.225999999999999},"last":1.835},{"interface":"front","average":{"1min":11.446999999999999,"5min":14.766999999999999,"15min":10.284000000000001},"min":{"1min":1.476,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":21.491,"5min":85.747,"15min":85.747},"last":1.871}]},{"osd":11,"last update":"Fri Nov 20 11:46:10 2020","interfaces":[{"interface":"back","average":{"1min":6.2990000000000004,"5min":14.617000000000001,"15min":9.0679999999999996},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":20.420000000000002,"5min":66.135999999999996,"15min":66.135999999999996},"last":1.6240000000000001},{"interface":"front","average":{"1min":6.4880000000000004,"5min":15.903,"15min":9.0139999999999993},"min":{"1min":1.179,"5min":1.179,"15min":1.179},"max":{"1min":21.344000000000001,"5min":85.456000000000003,"15min":85.456000000000003},"last":5.4930000000000003}]}]},{"osd":0,"up_from":17,"seq":73014444240,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306508,"kb_used_data":197124,"kb_used_omap":0,"kb_used_meta":109376,"kb_avail":94065332,"statfs":{"total":96636764160,"available":96322899968,"internally_reserved":0,"allocated":201854976,"data_stored":201689719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":112001024},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":7.2279999999999998,"15min":5.0069999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.53100000000000003},"max":{"1min":16.285,"5min":46.543999999999997,"15min":46.543999999999997},"last":0.873},{"interface":"front","average":{"1min":3.2719999999999998,"5min":7.3639999999999999,"15min":5.6900000000000004},"min":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.627},"max":{"1min":16.303999999999998,"5min":48.5,"15min":55.564},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1759999999999999,"15min":1.1000000000000001},"min":{"1min":0.76200000000000001,"5min":0.68799999999999994,"15min":0.499},"max":{"1min":1.4810000000000001,"5min":3.8690000000000002,"15min":4.218},"last":1.204},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0509999999999999,"15min":1.0289999999999999},"min":{"1min":0.753,"5min":0.56799999999999995,"15min":0.53800000000000003},"max":{"1min":1.367,"5min":5.5209999999999999,"15min":5.5209999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":3.5489999999999999,"15min":3.3380000000000001},"min":{"1min":0.75700000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"max":{"1min":1.383,"5min":36.844999999999999,"15min":36.844999999999999},"last":9.7270000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":4.5350000000000001,"15min":3.8140000000000001},"min":{"1min":0.84699999999999998,"5min":0.81899999999999995,"15min":0.70599999999999996},"max":{"1min":1.6890000000000001,"5min":46.908000000000001,"15min":46.908000000000001},"last":9.8190000000000008}]},{"osd":5,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.887,"15min":1.742},"min":{"1min":0.76300000000000001,"5min":0.73099999999999998,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":46.579000000000001,"15min":51.210999999999999},"last":1.123},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.0449999999999999,"15min":1.9430000000000001},"min":{"1min":1.1160000000000001,"5min":0.83999999999999997,"15min":0.68300000000000005},"max":{"1min":1.623,"5min":46.078000000000003,"15min":51.238},"last":1.29}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.105,"15min":1.6359999999999999},"min":{"1min":0.97299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0510000000000002,"5min":55.969999999999999,"15min":55.969999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.329,"5min":2.1339999999999999,"15min":1.6559999999999999},"min":{"1min":0.98799999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.825,"5min":57.426000000000002,"15min":57.426000000000002},"last":1.24}]},{"osd":7,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.0880000000000001,"15min":1.6919999999999999},"min":{"1min":1.0940000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0310000000000001,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.165},{"interface":"front","average":{"1min":1.6559999999999999,"5min":2.1930000000000001,"15min":1.7889999999999999},"min":{"1min":1.2769999999999999,"5min":1.0049999999999999,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":47.027000000000001,"15min":47.027000000000001},"last":1.6240000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":2.105,"15min":1.9590000000000001},"min":{"1min":1.0349999999999999,"5min":0.89600000000000002,"15min":0.65800000000000003},"max":{"1min":1.9490000000000001,"5min":47.246000000000002,"15min":50.509},"last":1.538},{"interface":"front","average":{"1min":1.5089999999999999,"5min":2.262,"15min":2.165},"min":{"1min":1.2929999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2,"5min":46.308,"15min":50.698},"last":1.571}]},{"osd":9,"last update":"Fri Nov 20 11:46:01 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":2.391,"15min":1.9630000000000001},"min":{"1min":1.4019999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":4.8070000000000004,"5min":47.418999999999997,"15min":47.418999999999997},"last":1.708},{"interface":"front","average":{"1min":1.8080000000000001,"5min":2.3460000000000001,"15min":1.887},"min":{"1min":1.246,"5min":0.94699999999999995,"15min":0.78600000000000003},"max":{"1min":4.7839999999999998,"5min":47.543999999999997,"15min":47.543999999999997},"last":1.7889999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.73,"5min":2.617,"15min":3.093},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":0.98199999999999998},"max":{"1min":2.4140000000000001,"5min":47.140000000000001,"15min":47.140000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":2.5,"15min":3.0379999999999998},"min":{"1min":1.3280000000000001,"5min":1.0640000000000001,"15min":0.95599999999999996},"max":{"1min":2.0489999999999999,"5min":46.703000000000003,"15min":46.703000000000003},"last":1.669}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":2.4900000000000002,"15min":2.0510000000000002},"min":{"1min":1.4079999999999999,"5min":1.139,"15min":1.1160000000000001},"max":{"1min":2.1760000000000002,"5min":46.200000000000003,"15min":46.200000000000003},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.7,"5min":2.4769999999999999,"15min":2.0230000000000001},"min":{"1min":1.4019999999999999,"5min":1.286,"15min":1.127},"max":{"1min":2.0950000000000002,"5min":48.350000000000001,"15min":48.350000000000001},"last":1.752}]}]},{"osd":2,"up_from":17,"seq":73014444239,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":632496,"kb_used_data":348456,"kb_used_omap":0,"kb_used_meta":275840,"kb_avail":93739344,"statfs":{"total":96636764160,"available":95989088256,"internally_reserved":0,"allocated":356818944,"data_stored":356652794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":282460160},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":4.9550000000000001,"5min":8.9930000000000003,"15min":6.2279999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":16.984000000000002,"5min":47.216000000000001,"15min":77.983000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":5.7549999999999999,"5min":9.5549999999999997,"15min":6.3490000000000002},"min":{"1min":0.64800000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":28.588000000000001,"5min":44.024999999999999,"15min":78.215000000000003},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.96499999999999997,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63200000000000001},"max":{"1min":5.3460000000000001,"5min":7.7690000000000001,"15min":9.4440000000000008},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.105,"15min":1.161},"min":{"1min":0.70399999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5069999999999999,"5min":8.2140000000000004,"15min":9.6769999999999996},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.343,"5min":4.5300000000000002,"15min":3.9660000000000002},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.51900000000000002},"max":{"1min":92.447999999999993,"5min":92.447999999999993,"15min":92.447999999999993},"last":18.725999999999999},{"interface":"front","average":{"1min":6.7359999999999998,"5min":5.0519999999999996,"15min":4.3940000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.68000000000000005},"max":{"1min":92.543000000000006,"5min":92.543000000000006,"15min":92.543000000000006},"last":18.850000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.3049999999999999,"15min":1.502},"min":{"1min":0.83499999999999996,"5min":0.69299999999999995,"15min":0.58599999999999997},"max":{"1min":5.7679999999999998,"5min":8.7469999999999999,"15min":11.797000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4330000000000001,"15min":1.615},"min":{"1min":0.94099999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.931,"5min":8.0950000000000006,"15min":10.281000000000001},"last":1.141}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.411},"min":{"1min":0.749,"5min":0.68200000000000005,"15min":0.67500000000000004},"max":{"1min":2.762,"5min":7.5339999999999998,"15min":9.3119999999999994},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.5469999999999999,"15min":1.6180000000000001},"min":{"1min":0.86599999999999999,"5min":0.83899999999999997,"15min":0.73899999999999999},"max":{"1min":5.899,"5min":11.779,"15min":11.779},"last":1.075}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.7030000000000001,"15min":1.9710000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.80000000000000004},"max":{"1min":18.559000000000001,"5min":18.559000000000001,"15min":77.819999999999993},"last":1.375},{"interface":"front","average":{"1min":2.8149999999999999,"5min":1.819,"15min":2.0129999999999999},"min":{"1min":1.101,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":31.295999999999999,"5min":31.295999999999999,"15min":78.126999999999995},"last":1.1779999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.7629999999999999,"15min":1.8640000000000001},"min":{"1min":1.002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":6.5039999999999996,"5min":8.5489999999999995,"15min":11.343999999999999},"last":1.204},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.756,"15min":2.0129999999999999},"min":{"1min":1.226,"5min":1.099,"15min":1.075},"max":{"1min":2.3610000000000002,"5min":8.6039999999999992,"15min":18.099},"last":1.224}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.726,"15min":1.879},"min":{"1min":1.2609999999999999,"5min":1.083,"15min":1.0629999999999999},"max":{"1min":2.6150000000000002,"5min":8.3659999999999997,"15min":10.129},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.655,"15min":1.7689999999999999},"min":{"1min":1.1439999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.411,"5min":7.7460000000000004,"15min":9.4220000000000006},"last":1.425}]},{"osd":10,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.9219999999999999,"15min":2.7349999999999999},"min":{"1min":1.361,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.6520000000000001,"5min":7.8650000000000002,"15min":78.016000000000005},"last":1.319},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.909,"15min":2.8220000000000001},"min":{"1min":1.238,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":6.3799999999999999,"5min":8.0250000000000004,"15min":77.741},"last":1.339}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.8580000000000001,"15min":2.0369999999999999},"min":{"1min":1.3879999999999999,"5min":1.246,"15min":1.2190000000000001},"max":{"1min":2.4969999999999999,"5min":8.7319999999999993,"15min":10.26},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.849,"15min":1.9830000000000001},"min":{"1min":1.405,"5min":1.113,"15min":1.113},"max":{"1min":2.5230000000000001,"5min":8.0540000000000003,"15min":9.6440000000000001},"last":1.498}]}]},{"osd":3,"up_from":17,"seq":73014444239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292008,"kb_used_data":192800,"kb_used_omap":0,"kb_used_meta":99200,"kb_avail":94079832,"statfs":{"total":96636764160,"available":96337747968,"internally_reserved":0,"allocated":197427200,"data_stored":197268667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101580800},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Fri Nov 20 11:45:55 2020","interfaces":[{"interface":"back","average":{"1min":4.1420000000000003,"5min":8.718,"15min":5.8630000000000004},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":19.181000000000001,"5min":109.33199999999999,"15min":109.33199999999999},"last":7.5179999999999998},{"interface":"front","average":{"1min":4.2060000000000004,"5min":8.9510000000000005,"15min":6.0069999999999997},"min":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":19.215,"5min":109.303,"15min":109.303},"last":7.5499999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.97099999999999997,"15min":1.496},"min":{"1min":0.64900000000000002,"5min":0.59599999999999997,"15min":0.54900000000000004},"max":{"1min":1.4239999999999999,"5min":3.3220000000000001,"15min":80.936999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.208,"15min":1.5},"min":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"max":{"1min":1.3140000000000001,"5min":8.2599999999999998,"15min":80.414000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":5.1989999999999998,"5min":5.2290000000000001,"15min":4.1050000000000004},"min":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.622},"max":{"1min":85.147999999999996,"5min":85.147999999999996,"15min":85.147999999999996},"last":17.100000000000001},{"interface":"front","average":{"1min":5.2750000000000004,"5min":5.4850000000000003,"15min":4.2290000000000001},"min":{"1min":0.70299999999999996,"5min":0.64400000000000002,"15min":0.59299999999999997},"max":{"1min":85.228999999999999,"5min":85.228999999999999,"15min":85.228999999999999},"last":17.154}]},{"osd":5,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3560000000000001,"15min":1.6679999999999999},"min":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.63300000000000001},"max":{"1min":1.724,"5min":6.9329999999999998,"15min":81.069999999999993},"last":0.879},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2729999999999999,"15min":1.5880000000000001},"min":{"1min":0.74399999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"max":{"1min":1.603,"5min":6.6399999999999997,"15min":80.777000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3700000000000001,"15min":1.2929999999999999},"min":{"1min":0.70599999999999996,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6970000000000001,"5min":4.944,"15min":5.7060000000000004},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.5309999999999999,"15min":1.4239999999999999},"min":{"1min":0.876,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8600000000000001,"5min":10.449,"15min":10.449},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3620000000000001,"15min":1.337},"min":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66000000000000003},"max":{"1min":1.6890000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.522,"15min":1.4370000000000001},"min":{"1min":0.94699999999999995,"5min":0.81799999999999995,"15min":0.79300000000000004},"max":{"1min":2.073,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":0.85599999999999998}]},{"osd":8,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5880000000000001,"15min":1.9370000000000001},"min":{"1min":1.024,"5min":0.94999999999999996,"15min":0.82199999999999995},"max":{"1min":1.9850000000000001,"5min":4.2190000000000003,"15min":80.457999999999998},"last":0.996},{"interface":"front","average":{"1min":1.425,"5min":1.6279999999999999,"15min":1.9750000000000001},"min":{"1min":1.05,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8180000000000001,"5min":8.1500000000000004,"15min":82.094999999999999},"last":1.044}]},{"osd":9,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6419999999999999,"15min":1.659},"min":{"1min":1.093,"5min":0.98599999999999999,"15min":0.94199999999999995},"max":{"1min":2.0009999999999999,"5min":6.048,"15min":7.6509999999999998},"last":1.181},{"interface":"front","average":{"1min":1.611,"5min":1.6919999999999999,"15min":1.7290000000000001},"min":{"1min":1.3320000000000001,"5min":0.90900000000000003,"15min":0.84799999999999998},"max":{"1min":2.1040000000000001,"5min":4.3949999999999996,"15min":7.8940000000000001},"last":1.232}]},{"osd":10,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":2.0800000000000001,"15min":2.5089999999999999},"min":{"1min":1.2330000000000001,"5min":1.0780000000000001,"15min":1.048},"max":{"1min":6.125,"5min":16.952999999999999,"15min":21.556000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.671,"5min":1.9450000000000001,"15min":2.508},"min":{"1min":1.321,"5min":1.2470000000000001,"15min":1.1140000000000001},"max":{"1min":2.226,"5min":8.7739999999999991,"15min":22.158999999999999},"last":1.349}]},{"osd":11,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.766,"15min":2.093},"min":{"1min":1.1259999999999999,"5min":1.0620000000000001,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":8.4969999999999999,"15min":81.783000000000001},"last":1.137},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.895,"15min":2.153},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":1.117},"max":{"1min":2.198,"5min":7.1210000000000004,"15min":81.853999999999999},"last":1.4159999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444239,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868904,"kb_used_data":508192,"kb_used_omap":0,"kb_used_meta":356608,"kb_avail":93502936,"statfs":{"total":96636764160,"available":95747006464,"internally_reserved":0,"allocated":520388608,"data_stored":520230075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":365166592},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":2.4350000000000001,"15min":2.5779999999999998},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.325,"5min":28.654,"15min":30.84},"last":1.022},{"interface":"front","average":{"1min":0.93999999999999995,"5min":2.5880000000000001,"15min":2.3799999999999999},"min":{"1min":0.65000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5700000000000001,"5min":28.18,"15min":31.724},"last":1.2490000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":8.0199999999999996,"5min":13.227,"15min":8.9049999999999994},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.64700000000000002},"max":{"1min":37.325000000000003,"5min":55.183999999999997,"15min":59.253},"last":1.123},{"interface":"front","average":{"1min":8.1029999999999998,"5min":13.624000000000001,"15min":10.289999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.61699999999999999},"max":{"1min":37.371000000000002,"5min":55.234999999999999,"15min":171.99199999999999},"last":32.415999999999997}]},{"osd":3,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":2.2949999999999999,"15min":2.859},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"max":{"1min":2.302,"5min":19.934999999999999,"15min":31.109000000000002},"last":30.826000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":3.956,"15min":3.6259999999999999},"min":{"1min":0.82599999999999996,"5min":0.68000000000000005,"15min":0.67300000000000004},"max":{"1min":1.726,"5min":37.377000000000002,"15min":37.377000000000002},"last":1.3280000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":3.081,"15min":3.214},"min":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.5670000000000002,"5min":28.321000000000002,"15min":32.130000000000003},"last":2.423},{"interface":"front","average":{"1min":1.379,"5min":2.5819999999999999,"15min":3.7349999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.5390000000000001,"5min":25.385000000000002,"15min":31.341000000000001},"last":30.960999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.0099999999999998,"15min":4.6829999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.66500000000000004},"max":{"1min":2.0329999999999999,"5min":44.808999999999997,"15min":62.055},"last":3.5350000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":4.758,"15min":4.0759999999999996},"min":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.464,"5min":44.914999999999999,"15min":61.060000000000002},"last":2.8719999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":4.8559999999999999,"15min":4.7000000000000002},"min":{"1min":0.79400000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.9870000000000001,"5min":44.597000000000001,"15min":45.829999999999998},"last":31.398},{"interface":"front","average":{"1min":1.76,"5min":6.2519999999999998,"15min":4.7720000000000002},"min":{"1min":0.95899999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":6.4699999999999998,"5min":54.201000000000001,"15min":54.201000000000001},"last":1.4570000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":7.1989999999999998,"15min":5.367},"min":{"1min":1.0309999999999999,"5min":0.878,"15min":0.878},"max":{"1min":2.5659999999999998,"5min":44.716000000000001,"15min":44.716000000000001},"last":2.806},{"interface":"front","average":{"1min":1.847,"5min":4.8700000000000001,"15min":4.8129999999999997},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.7489999999999997,"5min":44.753,"15min":44.753},"last":31.266999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":5.1970000000000001,"15min":4.1280000000000001},"min":{"1min":1.032,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.669,"5min":44.639000000000003,"15min":44.639000000000003},"last":2.5539999999999998},{"interface":"front","average":{"1min":1.6719999999999999,"5min":6.0030000000000001,"15min":5.2770000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.423,"5min":45.015999999999998,"15min":45.015999999999998},"last":31.087}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":8.5739999999999998,"15min":7.6470000000000002},"min":{"1min":1.147,"5min":1.147,"15min":1.1339999999999999},"max":{"1min":4.0099999999999998,"5min":44.954000000000001,"15min":45.936},"last":3.3780000000000001},{"interface":"front","average":{"1min":1.8169999999999999,"5min":6.6239999999999997,"15min":6.7519999999999998},"min":{"1min":1.1399999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.0309999999999997,"5min":44.784999999999997,"15min":50.340000000000003},"last":2.6749999999999998}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":6.0190000000000001,"15min":5.4640000000000004},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":4.8710000000000004,"5min":44.881999999999998,"15min":44.881999999999998},"last":31.170999999999999},{"interface":"front","average":{"1min":1.665,"5min":8.1489999999999991,"15min":6.048},"min":{"1min":1.208,"5min":1.093,"15min":1.093},"max":{"1min":2.2919999999999998,"5min":53.826999999999998,"15min":53.826999999999998},"last":3.2639999999999998}]}]},{"osd":5,"up_from":17,"seq":73014444239,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465640,"kb_used_data":258336,"kb_used_omap":0,"kb_used_meta":207296,"kb_avail":93906200,"statfs":{"total":96636764160,"available":96159948800,"internally_reserved":0,"allocated":264536064,"data_stored":264377531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":212271104},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.101,"15min":1.0580000000000001},"min":{"1min":0.65400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2929999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.089,"15min":1.0549999999999999},"min":{"1min":0.65100000000000002,"5min":0.62,"15min":0.60699999999999998},"max":{"1min":1.234,"5min":5.665,"15min":5.665},"last":0.97199999999999998}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":7.9820000000000002,"15min":6.2060000000000004},"min":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.63500000000000001},"max":{"1min":14.426,"5min":37.024999999999999,"15min":95.546999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":3.0659999999999998,"5min":7.8879999999999999,"15min":5.9630000000000001},"min":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":14.476000000000001,"5min":38.518000000000001,"15min":94.667000000000002},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.613,"15min":1.4990000000000001},"min":{"1min":0.68500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.647,"5min":22.68,"15min":22.68},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.552,"15min":1.371},"min":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.64400000000000002},"max":{"1min":1.3700000000000001,"5min":28.699999999999999,"15min":28.699999999999999},"last":1.2170000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":3.1179999999999999,"15min":4.0350000000000001},"min":{"1min":0.90500000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.992,"5min":19.047999999999998,"15min":92.614999999999995},"last":14.417},{"interface":"front","average":{"1min":1.286,"5min":3.0830000000000002,"15min":4.2560000000000002},"min":{"1min":1.0780000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.657,"5min":18.266999999999999,"15min":93.894000000000005},"last":14.667}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.6679999999999999,"15min":1.657},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.629},"max":{"1min":2.1389999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":1.026,"5min":1.006,"15min":0.91000000000000003},"max":{"1min":1.788,"5min":10.125,"15min":10.125},"last":1.105}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.593,"15min":1.601},"min":{"1min":0.96999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7070000000000001,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.841,"15min":1.867},"min":{"1min":1.161,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.2559999999999998,"5min":10.981999999999999,"15min":10.981999999999999},"last":1.327}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1349999999999998},"min":{"1min":1.302,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.3279999999999998,"5min":9.8010000000000002,"15min":45.292999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.623,"5min":2.0409999999999999,"15min":2.2389999999999999},"min":{"1min":1.3340000000000001,"5min":1.1830000000000001,"15min":1.0660000000000001},"max":{"1min":1.966,"5min":10.221,"15min":45.390000000000001},"last":1.246}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.9590000000000001,"15min":2.0880000000000001},"min":{"1min":1.3720000000000001,"5min":1.3180000000000001,"15min":1.202},"max":{"1min":2.056,"5min":9.9979999999999993,"15min":45.686999999999998},"last":1.401},{"interface":"front","average":{"1min":1.395,"5min":1.774,"15min":1.758},"min":{"1min":1.169,"5min":1.0760000000000001,"15min":0.93799999999999994},"max":{"1min":1.7509999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":1.385}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.9790000000000001,"15min":3.4340000000000002},"min":{"1min":1.276,"5min":1.153,"15min":1.103},"max":{"1min":2.5539999999999998,"5min":8.7330000000000005,"15min":96.786000000000001},"last":1.456},{"interface":"front","average":{"1min":1.661,"5min":2.105,"15min":3.5550000000000002},"min":{"1min":1.331,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.3999999999999999,"5min":10.847,"15min":95.569999999999993},"last":1.4710000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":2.1509999999999998,"15min":2.2490000000000001},"min":{"1min":1.419,"5min":1.3680000000000001,"15min":1.1990000000000001},"max":{"1min":2.1859999999999999,"5min":15.747,"15min":45.524000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.9650000000000001,"15min":2.137},"min":{"1min":1.3560000000000001,"5min":1.1679999999999999,"15min":1.163},"max":{"1min":1.8740000000000001,"5min":9.843,"15min":45.317999999999998},"last":1.5289999999999999}]}]}]}} 2020-11-20T11:46:27.144 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.145 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.145 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.146 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:29:24.749283+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=24, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.146 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.146 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.147 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.147 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:29:30.782930+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.147 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:29:27.763786+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=45, tm_sec=56, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:46:27.148 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T11:46:47.149 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:46:47.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.271+0000 7f0d654cd700 1 Processor -- start 2020-11-20T11:46:47.275 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.271+0000 7f0d654cd700 1 -- start start 2020-11-20T11:46:47.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d654cd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d6014f3f0 0x7f0d60065160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.277 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d654cd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d60067490 con 0x7f0d600c3bc0 2020-11-20T11:46:47.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d654cd700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d60065650 con 0x7f0d600c37e0 2020-11-20T11:46:47.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d654cd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6014f830 con 0x7f0d6014f3f0 2020-11-20T11:46:47.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d5f7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d6014f3f0 0x7f0d60065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.278 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d5f7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d6014f3f0 0x7f0d60065160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42686/0 (socket says 172.21.15.105:42686) 2020-11-20T11:46:47.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d5effd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0d600c37e0 0x7f0d600c0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.105:33070/0 (socket says 172.21.15.105:33070) 2020-11-20T11:46:47.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d5f7fe700 1 -- 172.21.15.105:0/310103933 learned_addr learned my addr 172.21.15.105:0/310103933 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:47.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.272+0000 7f0d5f7fe700 1 -- 172.21.15.105:0/310103933 >> v1:172.21.15.100:6789/0 conn(0x7f0d600c37e0 legacy=0x7f0d600c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5f7fe700 1 -- 172.21.15.105:0/310103933 >> v1:172.21.15.67:6789/0 conn(0x7f0d600c3bc0 legacy=0x7f0d60066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.279 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5dffb700 1 -- 172.21.15.105:0/310103933 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777740325 0 0) 0x7f0d60065650 con 0x7f0d600c37e0 2020-11-20T11:46:47.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5f7fe700 1 -- 172.21.15.105:0/310103933 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6014fa20 con 0x7f0d6014f3f0 2020-11-20T11:46:47.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5f7fe700 1 --2- 172.21.15.105:0/310103933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6014f3f0 0x7f0d60065160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0d600bfca0 tx=0x7f0d50006eb0).ready entity=mon.2 client_cookie=f6cbbe30993b9ace server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5dffb700 1 -- 172.21.15.105:0/310103933 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50009960 con 0x7f0d6014f3f0 2020-11-20T11:46:47.280 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5dffb700 1 -- 172.21.15.105:0/310103933 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50009ac0 con 0x7f0d6014f3f0 2020-11-20T11:46:47.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d5dffb700 1 -- 172.21.15.105:0/310103933 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50009e40 con 0x7f0d6014f3f0 2020-11-20T11:46:47.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 -- 172.21.15.105:0/310103933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6014f3f0 msgr2=0x7f0d60065160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 --2- 172.21.15.105:0/310103933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6014f3f0 0x7f0d60065160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0d600bfca0 tx=0x7f0d50006eb0).stop 2020-11-20T11:46:47.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 -- 172.21.15.105:0/310103933 shutdown_connections 2020-11-20T11:46:47.281 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 --2- 172.21.15.105:0/310103933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6014f3f0 0x7f0d60065160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 -- 172.21.15.105:0/310103933 >> 172.21.15.105:0/310103933 conn(0x7f0d600b9910 msgr2=0x7f0d600b9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:47.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 -- 172.21.15.105:0/310103933 shutdown_connections 2020-11-20T11:46:47.282 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.273+0000 7f0d654cd700 1 -- 172.21.15.105:0/310103933 wait complete. 2020-11-20T11:46:47.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.274+0000 7f0d654cd700 1 Processor -- start 2020-11-20T11:46:47.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.274+0000 7f0d654cd700 1 -- start start 2020-11-20T11:46:47.285 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d600c3bc0 0x7f0d6015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6014f3f0 0x7f0d60066950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.286 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60155db0 con 0x7f0d600c3bc0 2020-11-20T11:46:47.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60156050 con 0x7f0d6014f3f0 2020-11-20T11:46:47.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d654cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601562f0 con 0x7f0d600c37e0 2020-11-20T11:46:47.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.287 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42692/0 (socket says 172.21.15.105:42692) 2020-11-20T11:46:47.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 -- 172.21.15.105:0/3023579882 learned_addr learned my addr 172.21.15.105:0/3023579882 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:47.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5f7fe700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6014f3f0 0x7f0d60066950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5e7fc700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d600c3bc0 0x7f0d6015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 -- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6014f3f0 msgr2=0x7f0d60066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.288 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6014f3f0 0x7f0d60066950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 -- 172.21.15.105:0/3023579882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d600c3bc0 msgr2=0x7f0d6015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d600c3bc0 0x7f0d6015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.275+0000 7f0d5effd700 1 -- 172.21.15.105:0/3023579882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60154ea0 con 0x7f0d600c37e0 2020-11-20T11:46:47.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d5effd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f0d5800ca90 tx=0x7f0d58007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.289 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58005ac0 con 0x7f0d600c37e0 2020-11-20T11:46:47.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58005c20 con 0x7f0d600c37e0 2020-11-20T11:46:47.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d60155140 con 0x7f0d600c37e0 2020-11-20T11:46:47.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58007110 con 0x7f0d600c37e0 2020-11-20T11:46:47.290 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.276+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6015e5b0 con 0x7f0d600c37e0 2020-11-20T11:46:47.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.277+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d601564b0 con 0x7f0d600c37e0 2020-11-20T11:46:47.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.277+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0d58010030 con 0x7f0d600c37e0 2020-11-20T11:46:47.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.278+0000 7f0d46ffd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 0x7f0d3c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.278+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0d580a3240 con 0x7f0d600c37e0 2020-11-20T11:46:47.291 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.278+0000 7f0d5e7fc700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 0x7f0d3c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.279+0000 7f0d5e7fc700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 0x7f0d3c082af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0d6009bc90 tx=0x7f0d54009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.292 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.281+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0d58077c50 con 0x7f0d600c37e0 2020-11-20T11:46:47.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.447+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 --> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d60154ce0 con 0x7f0d3c080630 2020-11-20T11:46:47.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.453+0000 7f0d46ffd700 1 -- 172.21.15.105:0/3023579882 <== mgr.4105 v2:172.21.15.100:6800/24394 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149778 (secure 0 0 0) 0x7f0d60154ce0 con 0x7f0d3c080630 2020-11-20T11:46:47.458 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-11-20T11:46:47.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 msgr2=0x7f0d3c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 0x7f0d3c082af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0d6009bc90 tx=0x7f0d54009040).stop 2020-11-20T11:46:47.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 msgr2=0x7f0d601555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f0d5800ca90 tx=0x7f0d58007e60).stop 2020-11-20T11:46:47.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 shutdown_connections 2020-11-20T11:46:47.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6014f3f0 0x7f0d60066950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f0d3c080630 0x7f0d3c082af0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d600c37e0 0x7f0d601555e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 --2- 172.21.15.105:0/3023579882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d600c3bc0 0x7f0d6015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 >> 172.21.15.105:0/3023579882 conn(0x7f0d600b9910 msgr2=0x7f0d60061c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:47.461 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 shutdown_connections 2020-11-20T11:46:47.462 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.455+0000 7f0d654cd700 1 -- 172.21.15.105:0/3023579882 wait complete. 2020-11-20T11:46:47.462 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2020-11-20T11:46:47.470 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2020-11-20T11:46:45.475940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8664212,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":288216,"num_write_kb":14242169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17103,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82505,"ondisk_log_size":82505,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3087288,"kb_used_data":20440,"kb_used_omap":0,"kb_used_meta":3066752,"kb_avail":1129374792,"statfs":{"total":1159641169920,"available":1156479787008,"internally_reserved":0,"allocated":20930560,"data_stored":18964972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3140354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-155189248,"num_objects":-37,"num_object_clones":0,"num_object_copies":-148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003143"},"pg_stats":[{"pgid":"4.2","version":"28'15596","reported_seq":"15610","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.073616+0000","last_change":"2020-11-20T11:46:23.485322+0000","last_active":"2020-11-20T11:46:30.073616+0000","last_peered":"2020-11-20T11:46:30.073616+0000","last_clean":"2020-11-20T11:46:30.073616+0000","last_became_active":"2020-11-20T11:29:31.809847+0000","last_became_peered":"2020-11-20T11:29:31.809847+0000","last_unstale":"2020-11-20T11:46:30.073616+0000","last_undegraded":"2020-11-20T11:46:30.073616+0000","last_fullsized":"2020-11-20T11:46:30.073616+0000","mapping_epoch":26,"log_start":"28'5517","ondisk_log_start":"28'5517","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15479","last_scrub_stamp":"2020-11-20T11:46:23.485238+0000","last_deep_scrub":"28'15479","last_deep_scrub_stamp":"2020-11-20T11:46:23.485238+0000","last_clean_scrub_stamp":"2020-11-20T11:46:23.485238+0000","log_size":10079,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36311,"num_write_kb":1834562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,7],"acting":[1,9,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:16.885620+0000","last_change":"2020-11-20T11:46:16.885708+0000","last_active":"2020-11-20T11:46:16.885620+0000","last_peered":"2020-11-20T11:46:16.885620+0000","last_clean":"2020-11-20T11:46:16.885620+0000","last_became_active":"2020-11-20T11:29:25.766767+0000","last_became_peered":"2020-11-20T11:29:25.766767+0000","last_unstale":"2020-11-20T11:46:16.885620+0000","last_undegraded":"2020-11-20T11:46:16.885620+0000","last_fullsized":"2020-11-20T11:46:16.885620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:16.885611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:16.885611+0000","last_clean_scrub_stamp":"2020-11-20T11:46:16.885611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'35","reported_seq":"50","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:18.984155+0000","last_change":"2020-11-20T11:46:16.496661+0000","last_active":"2020-11-20T11:46:18.984155+0000","last_peered":"2020-11-20T11:46:18.984155+0000","last_clean":"2020-11-20T11:46:18.984155+0000","last_became_active":"2020-11-20T11:29:28.782033+0000","last_became_peered":"2020-11-20T11:29:28.782033+0000","last_unstale":"2020-11-20T11:46:18.984155+0000","last_undegraded":"2020-11-20T11:46:18.984155+0000","last_fullsized":"2020-11-20T11:46:18.984155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'33","last_scrub_stamp":"2020-11-20T11:46:16.496557+0000","last_deep_scrub":"28'33","last_deep_scrub_stamp":"2020-11-20T11:46:16.496557+0000","last_clean_scrub_stamp":"2020-11-20T11:46:16.496557+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"28'14472","reported_seq":"14486","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:34.204485+0000","last_change":"2020-11-20T11:46:34.204582+0000","last_active":"2020-11-20T11:46:34.204485+0000","last_peered":"2020-11-20T11:46:34.204485+0000","last_clean":"2020-11-20T11:46:34.204485+0000","last_became_active":"2020-11-20T11:29:31.797672+0000","last_became_peered":"2020-11-20T11:29:31.797672+0000","last_unstale":"2020-11-20T11:46:34.204485+0000","last_undegraded":"2020-11-20T11:46:34.204485+0000","last_fullsized":"2020-11-20T11:46:34.204485+0000","mapping_epoch":26,"log_start":"28'4374","ondisk_log_start":"28'4374","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14472","last_scrub_stamp":"2020-11-20T11:46:34.204479+0000","last_deep_scrub":"28'14472","last_deep_scrub_stamp":"2020-11-20T11:46:34.204479+0000","last_clean_scrub_stamp":"2020-11-20T11:46:34.204479+0000","log_size":10098,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34434,"num_write_kb":1663140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,10],"acting":[8,2,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:00.879051+0000","last_change":"2020-11-20T11:46:00.879131+0000","last_active":"2020-11-20T11:46:00.879051+0000","last_peered":"2020-11-20T11:46:00.879051+0000","last_clean":"2020-11-20T11:46:00.879051+0000","last_became_active":"2020-11-20T11:29:25.765319+0000","last_became_peered":"2020-11-20T11:29:25.765319+0000","last_unstale":"2020-11-20T11:46:00.879051+0000","last_undegraded":"2020-11-20T11:46:00.879051+0000","last_fullsized":"2020-11-20T11:46:00.879051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:00.879043+0000","last_clean_scrub_stamp":"2020-11-20T11:46:00.879043+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"28'1051","reported_seq":"1065","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.125071+0000","last_change":"2020-11-20T11:45:59.125193+0000","last_active":"2020-11-20T11:45:59.125071+0000","last_peered":"2020-11-20T11:45:59.125071+0000","last_clean":"2020-11-20T11:45:59.125071+0000","last_became_active":"2020-11-20T11:29:28.783166+0000","last_became_peered":"2020-11-20T11:29:28.783166+0000","last_unstale":"2020-11-20T11:45:59.125071+0000","last_undegraded":"2020-11-20T11:45:59.125071+0000","last_fullsized":"2020-11-20T11:45:59.125071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1051","last_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_deep_scrub":"28'1051","last_deep_scrub_stamp":"2020-11-20T11:45:59.125062+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.125062+0000","log_size":1051,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4421052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":4629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"28'14411","reported_seq":"14425","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.029415+0000","last_change":"2020-11-20T11:46:29.010452+0000","last_active":"2020-11-20T11:46:30.029415+0000","last_peered":"2020-11-20T11:46:30.029415+0000","last_clean":"2020-11-20T11:46:30.029415+0000","last_became_active":"2020-11-20T11:29:31.800229+0000","last_became_peered":"2020-11-20T11:29:31.800229+0000","last_unstale":"2020-11-20T11:46:30.029415+0000","last_undegraded":"2020-11-20T11:46:30.029415+0000","last_fullsized":"2020-11-20T11:46:30.029415+0000","mapping_epoch":26,"log_start":"28'4337","ondisk_log_start":"28'4337","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14401","last_scrub_stamp":"2020-11-20T11:46:29.010349+0000","last_deep_scrub":"28'14401","last_deep_scrub_stamp":"2020-11-20T11:46:29.010349+0000","last_clean_scrub_stamp":"2020-11-20T11:46:29.010349+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33897,"num_write_kb":1743294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,8,7],"acting":[2,1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.274613+0000","last_change":"2020-11-20T11:46:15.274721+0000","last_active":"2020-11-20T11:46:15.274613+0000","last_peered":"2020-11-20T11:46:15.274613+0000","last_clean":"2020-11-20T11:46:15.274613+0000","last_became_active":"2020-11-20T11:29:25.766781+0000","last_became_peered":"2020-11-20T11:29:25.766781+0000","last_unstale":"2020-11-20T11:46:15.274613+0000","last_undegraded":"2020-11-20T11:46:15.274613+0000","last_fullsized":"2020-11-20T11:46:15.274613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.274604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.274604+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.274604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'18","reported_seq":"33","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:01.615821+0000","last_change":"2020-11-20T11:46:01.615821+0000","last_active":"2020-11-20T11:46:01.615821+0000","last_peered":"2020-11-20T11:46:01.615821+0000","last_clean":"2020-11-20T11:46:01.615821+0000","last_became_active":"2020-11-20T11:29:28.835070+0000","last_became_peered":"2020-11-20T11:29:28.835070+0000","last_unstale":"2020-11-20T11:46:01.615821+0000","last_undegraded":"2020-11-20T11:46:01.615821+0000","last_fullsized":"2020-11-20T11:46:01.615821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2020-11-20T11:46:01.615737+0000","last_clean_scrub_stamp":"2020-11-20T11:46:01.615737+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'14889","reported_seq":"14903","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.112332+0000","last_change":"2020-11-20T11:46:29.540544+0000","last_active":"2020-11-20T11:46:30.112332+0000","last_peered":"2020-11-20T11:46:30.112332+0000","last_clean":"2020-11-20T11:46:30.112332+0000","last_became_active":"2020-11-20T11:29:31.809791+0000","last_became_peered":"2020-11-20T11:29:31.809791+0000","last_unstale":"2020-11-20T11:46:30.112332+0000","last_undegraded":"2020-11-20T11:46:30.112332+0000","last_fullsized":"2020-11-20T11:46:30.112332+0000","mapping_epoch":26,"log_start":"28'4832","ondisk_log_start":"28'4832","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14882","last_scrub_stamp":"2020-11-20T11:46:29.540478+0000","last_deep_scrub":"28'14882","last_deep_scrub_stamp":"2020-11-20T11:46:29.540478+0000","last_clean_scrub_stamp":"2020-11-20T11:46:29.540478+0000","log_size":10057,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35138,"num_write_kb":1743800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,4,9],"acting":[6,10,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:25.081350+0000","last_change":"2020-11-20T11:46:25.081440+0000","last_active":"2020-11-20T11:46:25.081350+0000","last_peered":"2020-11-20T11:46:25.081350+0000","last_clean":"2020-11-20T11:46:25.081350+0000","last_became_active":"2020-11-20T11:29:25.809805+0000","last_became_peered":"2020-11-20T11:29:25.809805+0000","last_unstale":"2020-11-20T11:46:25.081350+0000","last_undegraded":"2020-11-20T11:46:25.081350+0000","last_fullsized":"2020-11-20T11:46:25.081350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:25.081342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:25.081342+0000","last_clean_scrub_stamp":"2020-11-20T11:46:25.081342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'6","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:14.471628+0000","last_change":"2020-11-20T11:46:14.471715+0000","last_active":"2020-11-20T11:46:14.471628+0000","last_peered":"2020-11-20T11:46:14.471628+0000","last_clean":"2020-11-20T11:46:14.471628+0000","last_became_active":"2020-11-20T11:29:17.224174+0000","last_became_peered":"2020-11-20T11:29:17.224174+0000","last_unstale":"2020-11-20T11:46:14.471628+0000","last_undegraded":"2020-11-20T11:46:14.471628+0000","last_fullsized":"2020-11-20T11:46:14.471628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2020-11-20T11:46:14.471619+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2020-11-20T11:46:14.471619+0000","last_clean_scrub_stamp":"2020-11-20T11:46:14.471619+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12393,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:25.877153+0000","last_change":"2020-11-20T11:46:25.877252+0000","last_active":"2020-11-20T11:46:25.877153+0000","last_peered":"2020-11-20T11:46:25.877153+0000","last_clean":"2020-11-20T11:46:25.877153+0000","last_became_active":"2020-11-20T11:29:28.947295+0000","last_became_peered":"2020-11-20T11:29:28.947295+0000","last_unstale":"2020-11-20T11:46:25.877153+0000","last_undegraded":"2020-11-20T11:46:25.877153+0000","last_fullsized":"2020-11-20T11:46:25.877153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2020-11-20T11:46:25.877145+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2020-11-20T11:46:25.877145+0000","last_clean_scrub_stamp":"2020-11-20T11:46:25.877145+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'14785","reported_seq":"14799","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.043150+0000","last_change":"2020-11-20T11:46:13.657955+0000","last_active":"2020-11-20T11:46:30.043150+0000","last_peered":"2020-11-20T11:46:30.043150+0000","last_clean":"2020-11-20T11:46:30.043150+0000","last_became_active":"2020-11-20T11:29:31.795954+0000","last_became_peered":"2020-11-20T11:29:31.795954+0000","last_unstale":"2020-11-20T11:46:30.043150+0000","last_undegraded":"2020-11-20T11:46:30.043150+0000","last_fullsized":"2020-11-20T11:46:30.043150+0000","mapping_epoch":26,"log_start":"28'4750","ondisk_log_start":"28'4750","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14479","last_scrub_stamp":"2020-11-20T11:46:13.657891+0000","last_deep_scrub":"28'14479","last_deep_scrub_stamp":"2020-11-20T11:46:13.657891+0000","last_clean_scrub_stamp":"2020-11-20T11:46:13.657891+0000","log_size":10035,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34415,"num_write_kb":1724632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,2,6],"acting":[10,8,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:45:59.924469+0000","last_change":"2020-11-20T11:45:59.924526+0000","last_active":"2020-11-20T11:45:59.924469+0000","last_peered":"2020-11-20T11:45:59.924469+0000","last_clean":"2020-11-20T11:45:59.924469+0000","last_became_active":"2020-11-20T11:29:25.765460+0000","last_became_peered":"2020-11-20T11:29:25.765460+0000","last_unstale":"2020-11-20T11:45:59.924469+0000","last_undegraded":"2020-11-20T11:45:59.924469+0000","last_fullsized":"2020-11-20T11:45:59.924469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:45:59.924465+0000","last_clean_scrub_stamp":"2020-11-20T11:45:59.924465+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"28'66","reported_seq":"105","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:17.903488+0000","last_change":"2020-11-20T11:46:17.903583+0000","last_active":"2020-11-20T11:46:17.903488+0000","last_peered":"2020-11-20T11:46:17.903488+0000","last_clean":"2020-11-20T11:46:17.903488+0000","last_became_active":"2020-11-20T11:29:28.782602+0000","last_became_peered":"2020-11-20T11:29:28.782602+0000","last_unstale":"2020-11-20T11:46:17.903488+0000","last_undegraded":"2020-11-20T11:46:17.903488+0000","last_fullsized":"2020-11-20T11:46:17.903488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2020-11-20T11:46:17.903480+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2020-11-20T11:46:17.903480+0000","last_clean_scrub_stamp":"2020-11-20T11:46:17.903480+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":68,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'16084","reported_seq":"16098","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:33.046917+0000","last_change":"2020-11-20T11:46:33.047015+0000","last_active":"2020-11-20T11:46:33.046917+0000","last_peered":"2020-11-20T11:46:33.046917+0000","last_clean":"2020-11-20T11:46:33.046917+0000","last_became_active":"2020-11-20T11:29:31.810236+0000","last_became_peered":"2020-11-20T11:29:31.810236+0000","last_unstale":"2020-11-20T11:46:33.046917+0000","last_undegraded":"2020-11-20T11:46:33.046917+0000","last_fullsized":"2020-11-20T11:46:33.046917+0000","mapping_epoch":26,"log_start":"28'5997","ondisk_log_start":"28'5997","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16084","last_scrub_stamp":"2020-11-20T11:46:33.046912+0000","last_deep_scrub":"28'16084","last_deep_scrub_stamp":"2020-11-20T11:46:33.046912+0000","last_clean_scrub_stamp":"2020-11-20T11:46:33.046912+0000","log_size":10087,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37683,"num_write_kb":1831709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6,11],"acting":[1,4,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:02.356411+0000","last_change":"2020-11-20T11:46:02.356473+0000","last_active":"2020-11-20T11:46:02.356411+0000","last_peered":"2020-11-20T11:46:02.356411+0000","last_clean":"2020-11-20T11:46:02.356411+0000","last_became_active":"2020-11-20T11:29:25.765463+0000","last_became_peered":"2020-11-20T11:29:25.765463+0000","last_unstale":"2020-11-20T11:46:02.356411+0000","last_undegraded":"2020-11-20T11:46:02.356411+0000","last_fullsized":"2020-11-20T11:46:02.356411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:02.356408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:02.356408+0000","last_clean_scrub_stamp":"2020-11-20T11:46:02.356408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'563","reported_seq":"578","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:24.175291+0000","last_change":"2020-11-20T11:46:24.175391+0000","last_active":"2020-11-20T11:46:24.175291+0000","last_peered":"2020-11-20T11:46:24.175291+0000","last_clean":"2020-11-20T11:46:24.175291+0000","last_became_active":"2020-11-20T11:29:28.781607+0000","last_became_peered":"2020-11-20T11:29:28.781607+0000","last_unstale":"2020-11-20T11:46:24.175291+0000","last_undegraded":"2020-11-20T11:46:24.175291+0000","last_fullsized":"2020-11-20T11:46:24.175291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'563","last_scrub_stamp":"2020-11-20T11:46:24.175281+0000","last_deep_scrub":"28'563","last_deep_scrub_stamp":"2020-11-20T11:46:24.175281+0000","last_clean_scrub_stamp":"2020-11-20T11:46:24.175281+0000","log_size":563,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'15287","reported_seq":"15301","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.092420+0000","last_change":"2020-11-20T11:46:25.047204+0000","last_active":"2020-11-20T11:46:30.092420+0000","last_peered":"2020-11-20T11:46:30.092420+0000","last_clean":"2020-11-20T11:46:30.092420+0000","last_became_active":"2020-11-20T11:29:31.810011+0000","last_became_peered":"2020-11-20T11:29:31.810011+0000","last_unstale":"2020-11-20T11:46:30.092420+0000","last_undegraded":"2020-11-20T11:46:30.092420+0000","last_fullsized":"2020-11-20T11:46:30.092420+0000","mapping_epoch":26,"log_start":"28'5192","ondisk_log_start":"28'5192","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15202","last_scrub_stamp":"2020-11-20T11:46:25.047111+0000","last_deep_scrub":"28'15202","last_deep_scrub_stamp":"2020-11-20T11:46:25.047111+0000","last_clean_scrub_stamp":"2020-11-20T11:46:25.047111+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36852,"num_write_kb":1763006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,11,6],"acting":[5,9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'15","reported_seq":"30","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:24.516848+0000","last_change":"2020-11-20T11:46:24.516914+0000","last_active":"2020-11-20T11:46:24.516848+0000","last_peered":"2020-11-20T11:46:24.516848+0000","last_clean":"2020-11-20T11:46:24.516848+0000","last_became_active":"2020-11-20T11:29:28.835227+0000","last_became_peered":"2020-11-20T11:29:28.835227+0000","last_unstale":"2020-11-20T11:46:24.516848+0000","last_undegraded":"2020-11-20T11:46:24.516848+0000","last_fullsized":"2020-11-20T11:46:24.516848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2020-11-20T11:46:24.516842+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2020-11-20T11:46:24.516842+0000","last_clean_scrub_stamp":"2020-11-20T11:46:24.516842+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.131110+0000","last_change":"2020-11-20T11:46:15.131199+0000","last_active":"2020-11-20T11:46:15.131110+0000","last_peered":"2020-11-20T11:46:15.131110+0000","last_clean":"2020-11-20T11:46:15.131110+0000","last_became_active":"2020-11-20T11:29:26.041408+0000","last_became_peered":"2020-11-20T11:29:26.041408+0000","last_unstale":"2020-11-20T11:46:15.131110+0000","last_undegraded":"2020-11-20T11:46:15.131110+0000","last_fullsized":"2020-11-20T11:46:15.131110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.131101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.131101+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.131101+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'15988","reported_seq":"16002","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:30.112676+0000","last_change":"2020-11-20T11:46:15.728306+0000","last_active":"2020-11-20T11:46:30.112676+0000","last_peered":"2020-11-20T11:46:30.112676+0000","last_clean":"2020-11-20T11:46:30.112676+0000","last_became_active":"2020-11-20T11:29:31.842591+0000","last_became_peered":"2020-11-20T11:29:31.842591+0000","last_unstale":"2020-11-20T11:46:30.112676+0000","last_undegraded":"2020-11-20T11:46:30.112676+0000","last_fullsized":"2020-11-20T11:46:30.112676+0000","mapping_epoch":26,"log_start":"28'5904","ondisk_log_start":"28'5904","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15729","last_scrub_stamp":"2020-11-20T11:46:15.728249+0000","last_deep_scrub":"28'15729","last_deep_scrub_stamp":"2020-11-20T11:46:15.728249+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.728249+0000","log_size":10084,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37418,"num_write_kb":1928765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,3,0],"acting":[4,9,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:15.417256+0000","last_change":"2020-11-20T11:46:15.417328+0000","last_active":"2020-11-20T11:46:15.417256+0000","last_peered":"2020-11-20T11:46:15.417256+0000","last_clean":"2020-11-20T11:46:15.417256+0000","last_became_active":"2020-11-20T11:29:25.764662+0000","last_became_peered":"2020-11-20T11:29:25.764662+0000","last_unstale":"2020-11-20T11:46:15.417256+0000","last_undegraded":"2020-11-20T11:46:15.417256+0000","last_fullsized":"2020-11-20T11:46:15.417256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:46:15.417251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:46:15.417251+0000","last_clean_scrub_stamp":"2020-11-20T11:46:15.417251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'138","reported_seq":"153","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:46:05.819985+0000","last_change":"2020-11-20T11:46:05.820075+0000","last_active":"2020-11-20T11:46:05.819985+0000","last_peered":"2020-11-20T11:46:05.819985+0000","last_clean":"2020-11-20T11:46:05.819985+0000","last_became_active":"2020-11-20T11:29:28.779723+0000","last_became_peered":"2020-11-20T11:29:28.779723+0000","last_unstale":"2020-11-20T11:46:05.819985+0000","last_undegraded":"2020-11-20T11:46:05.819985+0000","last_fullsized":"2020-11-20T11:46:05.819985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'138","last_scrub_stamp":"2020-11-20T11:46:05.819978+0000","last_deep_scrub":"28'138","last_deep_scrub_stamp":"2020-11-20T11:46:05.819978+0000","last_clean_scrub_stamp":"2020-11-20T11:46:05.819978+0000","log_size":138,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286148,"num_write_kb":14232908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80609,"ondisk_log_size":80609,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8664212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":24,"num_read_kb":61,"num_write":2065,"num_write_kb":9246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17391616,"data_stored":17328424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1890,"ondisk_log_size":1890,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12393,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444244,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202584,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":202240,"kb_avail":94169256,"statfs":{"total":96636764160,"available":96429318144,"internally_reserved":0,"allocated":344064,"data_stored":183857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":207093760},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.61599999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3029999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":1.123},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.034,"15min":1.1519999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3919999999999999,"5min":2.8980000000000001,"15min":6.468},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.349,"15min":1.446},"min":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.621},"max":{"1min":1.655,"5min":12.504,"15min":12.504},"last":1.202},{"interface":"front","average":{"1min":1.03,"5min":1.1579999999999999,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.99399999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.96899999999999997,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.59899999999999998},"max":{"1min":1.2749999999999999,"5min":4.5279999999999996,"15min":4.5730000000000004},"last":1.026},{"interface":"front","average":{"1min":1.278,"5min":1.381,"15min":1.498},"min":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.6200000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":4.8010000000000002,"15min":4.1719999999999997},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.8979999999999999,"5min":52.670000000000002,"15min":52.670000000000002},"last":1.302},{"interface":"front","average":{"1min":1.181,"5min":5.0209999999999999,"15min":4.2240000000000002},"min":{"1min":0.81000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.839,"5min":52.637,"15min":52.637},"last":1.387}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.522},"min":{"1min":0.97799999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2000000000000002,"5min":4.2939999999999996,"15min":5.0599999999999996},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2729999999999999,"15min":1.4530000000000001},"min":{"1min":0.95799999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9410000000000001,"5min":5.2530000000000001,"15min":9.0850000000000009},"last":1.542}]},{"osd":6,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.7589999999999999,"15min":1.8440000000000001},"min":{"1min":1.2110000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.6470000000000002,"5min":5.9199999999999999,"15min":5.9199999999999999},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6850000000000001,"15min":1.7509999999999999},"min":{"1min":1.29,"5min":1.034,"15min":0.98699999999999999},"max":{"1min":4.6829999999999998,"5min":5.8739999999999997,"15min":6.9279999999999999},"last":1.76}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5640000000000001,"15min":1.9119999999999999},"min":{"1min":1.0600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0960000000000001,"5min":4.8579999999999997,"15min":69.603999999999999},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.77,"5min":1.7430000000000001,"15min":2.077},"min":{"1min":1.2430000000000001,"5min":1.151,"15min":1.151},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":66.614999999999995},"last":1.8879999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.641,"15min":1.823},"min":{"1min":1.1419999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.242,"5min":4.9800000000000004,"15min":6.2759999999999998},"last":1.849},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.7909999999999999,"15min":1.98},"min":{"1min":1.2989999999999999,"5min":1.2230000000000001,"15min":1.208},"max":{"1min":5.2910000000000004,"5min":5.2910000000000004,"15min":5.4790000000000001},"last":2.02}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.9610000000000001,"15min":2.0459999999999998},"min":{"1min":1.403,"5min":1.3540000000000001,"15min":1.218},"max":{"1min":5.3650000000000002,"5min":6.4669999999999996,"15min":6.6299999999999999},"last":2.1099999999999999},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.74,"15min":1.7689999999999999},"min":{"1min":1.204,"5min":1.139,"15min":1.0580000000000001},"max":{"1min":5.1509999999999998,"5min":5.2080000000000002,"15min":5.2080000000000002},"last":1.6579999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.905,"15min":2.8690000000000002},"min":{"1min":1.2090000000000001,"5min":1.085,"15min":1.085},"max":{"1min":3.7410000000000001,"5min":7.0149999999999997,"15min":34.558},"last":1.9790000000000001},{"interface":"front","average":{"1min":2.004,"5min":2.0249999999999999,"15min":2.9969999999999999},"min":{"1min":1.486,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4290000000000003,"5min":6.9260000000000002,"15min":33.133000000000003},"last":2.1850000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444243,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290152,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":289856,"kb_avail":94081688,"statfs":{"total":96636764160,"available":96339648512,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":296812544},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.2729999999999997,"5min":9.9610000000000003,"15min":7.29},"min":{"1min":0.71899999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":23.876999999999999,"5min":75.784000000000006,"15min":75.784000000000006},"last":0.94699999999999995},{"interface":"front","average":{"1min":6.9729999999999999,"5min":10.032999999999999,"15min":7.5670000000000002},"min":{"1min":0.76300000000000001,"5min":0.63,"15min":0.60099999999999998},"max":{"1min":24.201000000000001,"5min":75.831000000000003,"15min":75.831000000000003},"last":1.6040000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.387,"15min":1.7370000000000001},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.57199999999999995},"max":{"1min":2.3650000000000002,"5min":20.370000000000001,"15min":31.071000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.4830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.891,"5min":24.312999999999999,"15min":24.312999999999999},"last":1.2769999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5129999999999999,"15min":1.782},"min":{"1min":0.88,"5min":0.57099999999999995,"15min":0.54500000000000004},"max":{"1min":3.9740000000000002,"5min":20.204000000000001,"15min":25.420999999999999},"last":0.998},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.319,"15min":1.708},"min":{"1min":0.72899999999999998,"5min":0.67400000000000004,"15min":0.53500000000000003},"max":{"1min":2.6280000000000001,"5min":2.9380000000000002,"15min":20.030999999999999},"last":1.54}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":4.7720000000000002,"15min":5.4279999999999999},"min":{"1min":0.69199999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":25.651,"5min":35.222999999999999,"15min":43.152999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":2.8839999999999999,"5min":6.4249999999999998,"15min":6.3109999999999999},"min":{"1min":0.93600000000000005,"5min":0.91100000000000003,"15min":0.84199999999999997},"max":{"1min":25.908999999999999,"5min":44.122,"15min":46.593000000000004},"last":1.5720000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.8799999999999999,"15min":2.3180000000000001},"min":{"1min":0.66600000000000004,"5min":0.66000000000000003,"15min":0.63},"max":{"1min":4.1159999999999997,"5min":26.366,"15min":26.366},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.089,"15min":2.3679999999999999},"min":{"1min":0.83299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.7519999999999998,"5min":40.494,"15min":40.494},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.2160000000000002,"15min":2.2639999999999998},"min":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.59499999999999997},"max":{"1min":2.0209999999999999,"5min":25.873999999999999,"15min":25.873999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.7470000000000001,"5min":2.032,"15min":2.5379999999999998},"min":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73299999999999998},"max":{"1min":4.2229999999999999,"5min":23.809000000000001,"15min":25.771000000000001},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.282,"15min":2.5430000000000001},"min":{"1min":1.129,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.8809999999999998,"5min":23.800000000000001,"15min":24.831},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.8460000000000001,"5min":2.4209999999999998,"15min":2.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.75,"15min":0.74199999999999999},"max":{"1min":2.9329999999999998,"5min":24.748999999999999,"15min":24.748999999999999},"last":1.9099999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:46:00 2020","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":2.504,"15min":2.9009999999999998},"min":{"1min":1.1080000000000001,"5min":0.82099999999999995,"15min":0.80200000000000005},"max":{"1min":26.579000000000001,"5min":26.579000000000001,"15min":26.579000000000001},"last":1.8660000000000001},{"interface":"front","average":{"1min":3.2040000000000002,"5min":2.6219999999999999,"15min":3.0299999999999998},"min":{"1min":1.1639999999999999,"5min":0.92500000000000004,"15min":0.70499999999999996},"max":{"1min":26.748999999999999,"5min":40.624000000000002,"15min":40.624000000000002},"last":1.835}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":2.7949999999999999,"15min":2.952},"min":{"1min":1.175,"5min":0.90900000000000003,"15min":0.81100000000000005},"max":{"1min":2.4159999999999999,"5min":26.437000000000001,"15min":29.969999999999999},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.347,"15min":2.9790000000000001},"min":{"1min":1.1899999999999999,"5min":0.97299999999999998,"15min":0.80100000000000005},"max":{"1min":4.4459999999999997,"5min":25.498999999999999,"15min":29.881},"last":1.7310000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":2.2789999999999999,"15min":2.9380000000000002},"min":{"1min":1.427,"5min":1.004,"15min":1.004},"max":{"1min":3.0430000000000001,"5min":22.917000000000002,"15min":30.013999999999999},"last":1.944},{"interface":"front","average":{"1min":1.7909999999999999,"5min":2.641,"15min":3.1320000000000001},"min":{"1min":1.2909999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3290000000000002,"5min":25.626000000000001,"15min":28.550999999999998},"last":2.016}]}]},{"osd":9,"up_from":17,"seq":73014444243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385420,"kb_used_data":4612,"kb_used_omap":0,"kb_used_meta":380800,"kb_avail":93986420,"statfs":{"total":96636764160,"available":96242094080,"internally_reserved":0,"allocated":4722688,"data_stored":4557431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":389939200},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":1.0600000000000001,"15min":0.93999999999999995},"min":{"1min":0.76000000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.331,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.70899999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.9330000000000001,"5min":5.3170000000000002,"15min":6.7969999999999997},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":8.2119999999999997,"15min":6.3630000000000004},"min":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.65100000000000002},"max":{"1min":16.420999999999999,"5min":37.811999999999998,"15min":114.867},"last":1.2410000000000001},{"interface":"front","average":{"1min":2.7330000000000001,"5min":8.1440000000000001,"15min":6.1429999999999998},"min":{"1min":0.73899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":16.260999999999999,"5min":37.152999999999999,"15min":114.36799999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.248,"15min":1.6040000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.7050000000000001,"5min":7.0990000000000002,"15min":53.234000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.3580000000000001,"15min":1.669},"min":{"1min":0.88900000000000001,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.8720000000000001,"5min":5.5919999999999996,"15min":54.753},"last":1.214}]},{"osd":3,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.405,"15min":1.3879999999999999},"min":{"1min":0.81299999999999994,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.768,"5min":5.6390000000000002,"15min":7.2080000000000002},"last":1.115},{"interface":"front","average":{"1min":1.361,"5min":1.4610000000000001,"15min":1.411},"min":{"1min":1.097,"5min":0.746,"15min":0.746},"max":{"1min":1.899,"5min":7.234,"15min":7.234},"last":1.431}]},{"osd":4,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":4.5919999999999996,"15min":3.927},"min":{"1min":1.246,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0139999999999998,"5min":37.531999999999996,"15min":84.661000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":4.6280000000000001,"15min":3.9750000000000001},"min":{"1min":1.0069999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.327,"5min":37.469000000000001,"15min":84.811000000000007},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":1.804},"min":{"1min":1.012,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0960000000000001,"5min":7.3639999999999999,"15min":53.052},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.702,"15min":1.869},"min":{"1min":1.321,"5min":1.05,"15min":1.0189999999999999},"max":{"1min":2.137,"5min":6.1299999999999999,"15min":53.853000000000002},"last":1.353}]},{"osd":6,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.7330000000000001,"15min":1.706},"min":{"1min":1.1919999999999999,"5min":1.03,"15min":1.03},"max":{"1min":2.0630000000000002,"5min":5.7720000000000002,"15min":7.3410000000000002},"last":1.407},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.698,"15min":1.7110000000000001},"min":{"1min":1.1719999999999999,"5min":1,"15min":0.84399999999999997},"max":{"1min":2.282,"5min":7.5979999999999999,"15min":9.0199999999999996},"last":1.3169999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.869,"15min":2.1190000000000002},"min":{"1min":1.3029999999999999,"5min":1.163,"15min":1.163},"max":{"1min":2.2629999999999999,"5min":7.7619999999999996,"15min":54.600999999999999},"last":1.48},{"interface":"front","average":{"1min":1.706,"5min":1.893,"15min":2.2789999999999999},"min":{"1min":1.276,"5min":1.139,"15min":1.139},"max":{"1min":2.1989999999999998,"5min":9.8450000000000006,"15min":55.698},"last":1.4990000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8899999999999999,"15min":2.6320000000000001},"min":{"1min":1.3400000000000001,"5min":1.2430000000000001,"15min":1.2},"max":{"1min":3.1179999999999999,"5min":7.484,"15min":21.552},"last":1.554},{"interface":"front","average":{"1min":1.802,"5min":1.958,"15min":2.5529999999999999},"min":{"1min":1.411,"5min":1.173,"15min":1.0760000000000001},"max":{"1min":3.1389999999999998,"5min":6.9050000000000002,"15min":21.600999999999999},"last":1.5960000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:43 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.9239999999999999,"15min":2.0880000000000001},"min":{"1min":1.3240000000000001,"5min":1.2290000000000001,"15min":1.157},"max":{"1min":2.468,"5min":6.0499999999999998,"15min":53.317},"last":1.575},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.9179999999999999,"15min":2.1309999999999998},"min":{"1min":1.4159999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.23,"5min":7.7270000000000003,"15min":53.140000000000001},"last":1.657}]}]},{"osd":8,"up_from":17,"seq":73014444243,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294392,"kb_used_data":4400,"kb_used_omap":0,"kb_used_meta":289984,"kb_avail":94077448,"statfs":{"total":96636764160,"available":96335306752,"internally_reserved":0,"allocated":4505600,"data_stored":4331486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":296943616},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":1.3009999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":71.022999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98699999999999999,"15min":1.3839999999999999},"min":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.56100000000000005},"max":{"1min":2.827,"5min":6.1589999999999998,"15min":70.582999999999998},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":7.8869999999999996,"15min":5.6749999999999998},"min":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":9.5350000000000001,"5min":54.277999999999999,"15min":55.158999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":2.2290000000000001,"5min":8.3379999999999992,"15min":5.9969999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":10.224,"5min":54.159999999999997,"15min":55.703000000000003},"last":1.173}]},{"osd":2,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.24,"15min":1.391},"min":{"1min":0.68400000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.9950000000000001,"5min":4.9950000000000001,"15min":8.8699999999999992},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2050000000000001,"15min":1.2390000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.624},"max":{"1min":5.0270000000000001,"5min":5.7990000000000004,"15min":6.0810000000000004},"last":1.1419999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2989999999999999,"15min":1.7529999999999999},"min":{"1min":0.91100000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1230000000000002,"5min":6.4059999999999997,"15min":70.391000000000005},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.8240000000000001},"min":{"1min":1.034,"5min":0.98999999999999999,"15min":0.94999999999999996},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":70.510000000000005},"last":1.395}]},{"osd":4,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":4.891,"15min":4.5730000000000004},"min":{"1min":1.077,"5min":0.94299999999999995,"15min":0.88300000000000001},"max":{"1min":17.567,"5min":49.796999999999997,"15min":88.828000000000003},"last":1.681},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.468,"15min":4.1710000000000003},"min":{"1min":1.016,"5min":0.72499999999999998,"15min":0.69899999999999995},"max":{"1min":17.832999999999998,"5min":49.468000000000004,"15min":88.775999999999996},"last":1.2869999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3440000000000001,"15min":1.534},"min":{"1min":0.96399999999999997,"5min":0.84499999999999997,"15min":0.75900000000000001},"max":{"1min":2.0070000000000001,"5min":2.3530000000000002,"15min":8.2010000000000005},"last":1.573},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.585,"15min":1.871},"min":{"1min":1.133,"5min":1.0389999999999999,"15min":0.90300000000000002},"max":{"1min":2.4489999999999998,"5min":6.3109999999999999,"15min":19.702999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.8819999999999999,"15min":2.0110000000000001},"min":{"1min":1.202,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2280000000000002,"5min":18.169,"15min":18.169},"last":1.706},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.8,"15min":1.966},"min":{"1min":1.2370000000000001,"5min":1.1439999999999999,"15min":1.125},"max":{"1min":5.9939999999999998,"5min":5.9939999999999998,"15min":9.4499999999999993},"last":1.496}]},{"osd":9,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.5660000000000001,"15min":1.911},"min":{"1min":1.1060000000000001,"5min":1.034,"15min":1.0029999999999999},"max":{"1min":1.6559999999999999,"5min":7.7770000000000001,"15min":70.606999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.8859999999999999,"15min":2.3140000000000001},"min":{"1min":1.2689999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3370000000000002,"5min":18.033999999999999,"15min":75.585999999999999},"last":1.8540000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":2.2549999999999999,"15min":3.2029999999999998},"min":{"1min":1.3360000000000001,"5min":1.2170000000000001,"15min":1.171},"max":{"1min":7.077,"5min":13.571,"15min":73.167000000000002},"last":1.764},{"interface":"front","average":{"1min":1.663,"5min":2.04,"15min":3.0230000000000001},"min":{"1min":1.393,"5min":1.22,"15min":0.90000000000000002},"max":{"1min":3.3119999999999998,"5min":13.545999999999999,"15min":73.046999999999997},"last":1.667}]},{"osd":11,"last update":"Fri Nov 20 11:45:54 2020","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":2.0579999999999998,"15min":2.242},"min":{"1min":1.29,"5min":1.29,"15min":1.1519999999999999},"max":{"1min":3.762,"5min":18.279,"15min":18.279},"last":1.996},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.8149999999999999,"15min":2.0550000000000002},"min":{"1min":1.302,"5min":1.2729999999999999,"15min":1.1699999999999999},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":9.359},"last":1.597}]}]},{"osd":7,"up_from":17,"seq":73014444243,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":182832,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":182528,"kb_avail":94189008,"statfs":{"total":96636764160,"available":96449544192,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":186908672},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.1359999999999999},"min":{"1min":0.55100000000000005,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":1.667,"5min":3.9369999999999998,"15min":39.671999999999997},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":1.1160000000000001},"min":{"1min":0.627,"5min":0.54700000000000004,"15min":0.496},"max":{"1min":2.7589999999999999,"5min":4.21,"15min":36.548000000000002},"last":0.96599999999999997}]},{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":8.4309999999999992,"15min":6.0629999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.61499999999999999},"max":{"1min":17.905999999999999,"5min":51.244999999999997,"15min":115.669},"last":0.72199999999999998},{"interface":"front","average":{"1min":3.5960000000000001,"5min":9.0039999999999996,"15min":6.1980000000000004},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.63500000000000001},"max":{"1min":18.001000000000001,"5min":51.121000000000002,"15min":115.831},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.421,"15min":1.6279999999999999},"min":{"1min":0.73399999999999999,"5min":0.63800000000000001,"15min":0.46800000000000003},"max":{"1min":3.2810000000000001,"5min":5.8120000000000003,"15min":52.776000000000003},"last":1.127},{"interface":"front","average":{"1min":1.341,"5min":1.355,"15min":1.5609999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":6.931,"5min":8.5619999999999994,"15min":52.869999999999997},"last":1.1080000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2669999999999999,"15min":1.571},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.875,"5min":4.3300000000000001,"15min":39.496000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.49,"5min":1.639,"15min":1.651},"min":{"1min":0.93000000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.9020000000000001,"5min":6.7359999999999998,"15min":37.078000000000003},"last":1.4550000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":4.4820000000000002,"15min":4.7359999999999998},"min":{"1min":0.86499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.0940000000000003,"5min":29.015000000000001,"15min":115.108},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.611,"5min":4.843,"15min":4.9210000000000003},"min":{"1min":1.04,"5min":0.623,"15min":0.623},"max":{"1min":2.98,"5min":29.611999999999998,"15min":114.602},"last":1.0629999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5409999999999999,"15min":1.6950000000000001},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.76600000000000001},"max":{"1min":3.1779999999999999,"5min":4.4539999999999997,"15min":37.802},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.772,"15min":1.849},"min":{"1min":1.0189999999999999,"5min":0.89100000000000001,"15min":0.73599999999999999},"max":{"1min":3.1440000000000001,"5min":6.8920000000000003,"15min":37.234000000000002},"last":1.609}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.476,"15min":1.752},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.60299999999999998},"max":{"1min":3.9750000000000001,"5min":4.9139999999999997,"15min":53.584000000000003},"last":1.409},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.73,"15min":1.9490000000000001},"min":{"1min":1.0429999999999999,"5min":0.84499999999999997,"15min":0.73299999999999998},"max":{"1min":3.0819999999999999,"5min":4.6929999999999996,"15min":52.744},"last":1.173}]},{"osd":9,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.847,"15min":2.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.028,"5min":7.1680000000000001,"15min":35.851999999999997},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.776,"5min":1.6000000000000001,"15min":1.7769999999999999},"min":{"1min":1.069,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":3.8559999999999999,"5min":4.1849999999999996,"15min":36.921999999999997},"last":1.5429999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.925,"5min":1.9630000000000001,"15min":2.8180000000000001},"min":{"1min":1.171,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":3.411,"5min":8.5410000000000004,"15min":113.55800000000001},"last":1.383},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.9670000000000001,"15min":2.9940000000000002},"min":{"1min":1.103,"5min":1.0700000000000001,"15min":0.85799999999999998},"max":{"1min":3.286,"5min":7.0389999999999997,"15min":117.624},"last":1.8049999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.7509999999999999,"15min":1.881},"min":{"1min":1.165,"5min":0.90200000000000002,"15min":0.77400000000000002},"max":{"1min":4.2169999999999996,"5min":4.8390000000000004,"15min":34.616999999999997},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.877,"5min":1.8859999999999999,"15min":1.986},"min":{"1min":1.3300000000000001,"5min":1.0569999999999999,"15min":0.96199999999999997},"max":{"1min":3.302,"5min":4.9199999999999999,"15min":34.640000000000001},"last":1.502}]}]},{"osd":6,"up_from":17,"seq":73014444244,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376672,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":376320,"kb_avail":93995168,"statfs":{"total":96636764160,"available":96251052032,"internally_reserved":0,"allocated":352256,"data_stored":184017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":385351680},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":7.5279999999999996,"15min":5.0430000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.56299999999999994},"max":{"1min":21.082000000000001,"5min":61.689,"15min":61.689},"last":0.64700000000000002},{"interface":"front","average":{"1min":2.2589999999999999,"5min":6.6390000000000002,"15min":4.8529999999999998},"min":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"max":{"1min":14.728,"5min":44.164000000000001,"15min":44.350999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.3380000000000001,"5min":4.274,"15min":5.242},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0660000000000001,"15min":1.135},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56899999999999995},"max":{"1min":1.601,"5min":6.6609999999999996,"15min":7.4770000000000003},"last":1.0760000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.077,"15min":1.0720000000000001},"min":{"1min":0.69299999999999995,"5min":0.627,"15min":0.54000000000000004},"max":{"1min":2.3359999999999999,"5min":4.8360000000000003,"15min":8.2520000000000007},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.121},"min":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.60899999999999999},"max":{"1min":2.657,"5min":3.6000000000000001,"15min":5.758},"last":0.627}]},{"osd":4,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":4.1029999999999998,"15min":3.7599999999999998},"min":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.70299999999999996},"max":{"1min":11.422000000000001,"5min":54.881,"15min":54.881},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.8799999999999999,"5min":4.4870000000000001,"15min":3.931},"min":{"1min":1.008,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":11.472,"5min":54.957999999999998,"15min":54.957999999999998},"last":1.202}]},{"osd":5,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.546,"15min":1.466},"min":{"1min":0.90900000000000003,"5min":0.81000000000000005,"15min":0.60599999999999998},"max":{"1min":2.02,"5min":7.1909999999999998,"15min":7.7300000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4039999999999999,"15min":1.4450000000000001},"min":{"1min":0.88200000000000001,"5min":0.79200000000000004,"15min":0.72099999999999997},"max":{"1min":2.6859999999999999,"5min":6.4539999999999997,"15min":7.5419999999999998},"last":1.165}]},{"osd":7,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.419,"15min":1.4630000000000001},"min":{"1min":0.88600000000000001,"5min":0.84499999999999997,"15min":0.72799999999999998},"max":{"1min":3.0059999999999998,"5min":5.1470000000000002,"15min":8.3800000000000008},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5309999999999999,"15min":1.506},"min":{"1min":1.0609999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5339999999999998,"5min":3.8460000000000001,"15min":6.0229999999999997},"last":1.1020000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.659,"15min":1.6120000000000001},"min":{"1min":1.155,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8660000000000001,"5min":7.4710000000000001,"15min":7.4710000000000001},"last":1.329},{"interface":"front","average":{"1min":1.51,"5min":1.7909999999999999,"15min":1.8720000000000001},"min":{"1min":1.087,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.911,"5min":10.055999999999999,"15min":10.065},"last":1.292}]},{"osd":9,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.641,"15min":1.6419999999999999},"min":{"1min":1.228,"5min":1.0700000000000001,"15min":1.026},"max":{"1min":3.0059999999999998,"5min":4.4429999999999996,"15min":6.141},"last":1.224},{"interface":"front","average":{"1min":1.663,"5min":1.76,"15min":1.679},"min":{"1min":1.252,"5min":0.98899999999999999,"15min":0.82699999999999996},"max":{"1min":2.4630000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":1.4470000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":1.8300000000000001,"15min":2.1739999999999999},"min":{"1min":1.288,"5min":1.145,"15min":1.145},"max":{"1min":2.8900000000000001,"5min":5.8179999999999996,"15min":18.337},"last":1.349},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.847,"15min":2.2440000000000002},"min":{"1min":1.1040000000000001,"5min":1.0569999999999999,"15min":0.93600000000000005},"max":{"1min":2.1030000000000002,"5min":7.6130000000000004,"15min":23.823},"last":1.538}]},{"osd":11,"last update":"Fri Nov 20 11:45:56 2020","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.7130000000000001,"15min":1.7450000000000001},"min":{"1min":1.181,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":3.0720000000000001,"5min":6.6059999999999999,"15min":7.9660000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.736,"5min":1.845,"15min":1.796},"min":{"1min":1.357,"5min":1.163,"15min":1.119},"max":{"1min":2.7749999999999999,"5min":5.2089999999999996,"15min":6.2640000000000002},"last":1.4710000000000001}]}]},{"osd":1,"up_from":17,"seq":73014444242,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273200,"kb_used_data":4392,"kb_used_omap":0,"kb_used_meta":268800,"kb_avail":94098640,"statfs":{"total":96636764160,"available":96357007360,"internally_reserved":0,"allocated":4497408,"data_stored":4331326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":275251200},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":5.0309999999999997,"15min":3.8330000000000002},"min":{"1min":0.72399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":19.308,"5min":44.576000000000001,"15min":57.322000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":3.7400000000000002,"5min":6.452,"15min":3.722},"min":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.61299999999999999},"max":{"1min":20.452999999999999,"5min":68.094999999999999,"15min":68.094999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":6.2800000000000002,"15min":4.6559999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"max":{"1min":19.183,"5min":64.680000000000007,"15min":64.680000000000007},"last":1.5629999999999999},{"interface":"front","average":{"1min":3.5950000000000002,"5min":5.2889999999999997,"15min":3.5449999999999999},"min":{"1min":0.66300000000000003,"5min":0.63,"15min":0.63},"max":{"1min":19.152999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":1.254}]},{"osd":3,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":4.931,"5min":6.6050000000000004,"15min":4.4480000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":20.582000000000001,"5min":68.230000000000004,"15min":68.230000000000004},"last":1.3200000000000001},{"interface":"front","average":{"1min":5.9900000000000002,"5min":7.9950000000000001,"15min":5.2060000000000004},"min":{"1min":0.98999999999999999,"5min":0.85699999999999998,"15min":0.66900000000000004},"max":{"1min":19.859000000000002,"5min":64.951999999999998,"15min":64.951999999999998},"last":1.389}]},{"osd":4,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":17.652999999999999,"15min":11.912000000000001},"min":{"1min":0.87,"5min":0.71499999999999997,"15min":0.66000000000000003},"max":{"1min":20.414000000000001,"5min":68.141000000000005,"15min":68.141000000000005},"last":1.2210000000000001},{"interface":"front","average":{"1min":6.157,"5min":16.033999999999999,"15min":11.202},"min":{"1min":0.76900000000000002,"5min":0.751,"15min":0.63500000000000001},"max":{"1min":19.780000000000001,"5min":68.816000000000003,"15min":68.816000000000003},"last":1.131}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.2050000000000001,"5min":6.8840000000000003,"15min":4.6050000000000004},"min":{"1min":0.84899999999999998,"5min":0.78500000000000003,"15min":0.76100000000000001},"max":{"1min":19.414000000000001,"5min":64.760999999999996,"15min":64.760999999999996},"last":0.94999999999999996},{"interface":"front","average":{"1min":7.2839999999999998,"5min":9.4559999999999995,"15min":5.976},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.81499999999999995},"max":{"1min":21.158999999999999,"5min":68.406000000000006,"15min":68.406000000000006},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":6.5800000000000001,"5min":11.606,"15min":7.2130000000000001},"min":{"1min":1.1970000000000001,"5min":0.98699999999999999,"15min":0.73499999999999999},"max":{"1min":20.064,"5min":64.828999999999994,"15min":64.828999999999994},"last":1.6990000000000001},{"interface":"front","average":{"1min":9.4830000000000005,"5min":10.178000000000001,"15min":6.1470000000000002},"min":{"1min":1.1439999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":20.606999999999999,"5min":64.905000000000001,"15min":64.905000000000001},"last":1.357}]},{"osd":8,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":7.2530000000000001,"5min":9.9480000000000004,"15min":6.2359999999999998},"min":{"1min":1.1020000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":20.085000000000001,"5min":64.637,"15min":64.637},"last":1.45},{"interface":"front","average":{"1min":8.6590000000000007,"5min":12.173999999999999,"15min":7.04},"min":{"1min":1.173,"5min":0.98899999999999999,"15min":0.97499999999999998},"max":{"1min":21.402999999999999,"5min":85.200000000000003,"15min":85.200000000000003},"last":1.6259999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":9.6660000000000004,"5min":13.859999999999999,"15min":7.4699999999999998},"min":{"1min":1.0549999999999999,"5min":1.048,"15min":1.036},"max":{"1min":21.271000000000001,"5min":85.361000000000004,"15min":85.361000000000004},"last":1.98},{"interface":"front","average":{"1min":8.4830000000000005,"5min":11.747,"15min":7.782},"min":{"1min":1.3200000000000001,"5min":1.29,"15min":1.226},"max":{"1min":20.303999999999998,"5min":66.25,"15min":66.25},"last":1.946}]},{"osd":10,"last update":"Fri Nov 20 11:45:52 2020","interfaces":[{"interface":"back","average":{"1min":10.364000000000001,"5min":12.771000000000001,"15min":9.2509999999999994},"min":{"1min":1.242,"5min":1.181,"15min":1.079},"max":{"1min":20.744,"5min":65.650000000000006,"15min":75.225999999999999},"last":1.544},{"interface":"front","average":{"1min":11.446999999999999,"5min":14.766999999999999,"15min":10.284000000000001},"min":{"1min":1.476,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":21.491,"5min":85.747,"15min":85.747},"last":1.867}]},{"osd":11,"last update":"Fri Nov 20 11:46:10 2020","interfaces":[{"interface":"back","average":{"1min":6.2990000000000004,"5min":14.617000000000001,"15min":9.0679999999999996},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":20.420000000000002,"5min":66.135999999999996,"15min":66.135999999999996},"last":1.827},{"interface":"front","average":{"1min":6.4880000000000004,"5min":15.903,"15min":9.0139999999999993},"min":{"1min":1.179,"5min":1.179,"15min":1.179},"max":{"1min":21.344000000000001,"5min":85.456000000000003,"15min":85.456000000000003},"last":1.7490000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444244,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119500,"kb_used_data":4612,"kb_used_omap":0,"kb_used_meta":114880,"kb_avail":94252340,"statfs":{"total":96636764160,"available":96514396160,"internally_reserved":0,"allocated":4722688,"data_stored":4557431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":117637120},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":7.2279999999999998,"15min":5.0069999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.53100000000000003},"max":{"1min":16.285,"5min":46.543999999999997,"15min":46.543999999999997},"last":0.95299999999999996},{"interface":"front","average":{"1min":3.2719999999999998,"5min":7.3639999999999999,"15min":5.6900000000000004},"min":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.627},"max":{"1min":16.303999999999998,"5min":48.5,"15min":55.564},"last":1.121}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1759999999999999,"15min":1.1000000000000001},"min":{"1min":0.76200000000000001,"5min":0.68799999999999994,"15min":0.499},"max":{"1min":1.4810000000000001,"5min":3.8690000000000002,"15min":4.218},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0509999999999999,"15min":1.0289999999999999},"min":{"1min":0.753,"5min":0.56799999999999995,"15min":0.53800000000000003},"max":{"1min":1.367,"5min":5.5209999999999999,"15min":5.5209999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":3.5489999999999999,"15min":3.3380000000000001},"min":{"1min":0.75700000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"max":{"1min":1.383,"5min":36.844999999999999,"15min":36.844999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":4.5350000000000001,"15min":3.8140000000000001},"min":{"1min":0.84699999999999998,"5min":0.81899999999999995,"15min":0.70599999999999996},"max":{"1min":1.6890000000000001,"5min":46.908000000000001,"15min":46.908000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.887,"15min":1.742},"min":{"1min":0.76300000000000001,"5min":0.73099999999999998,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":46.579000000000001,"15min":51.210999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.0449999999999999,"15min":1.9430000000000001},"min":{"1min":1.1160000000000001,"5min":0.83999999999999997,"15min":0.68300000000000005},"max":{"1min":1.623,"5min":46.078000000000003,"15min":51.238},"last":1.4039999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.105,"15min":1.6359999999999999},"min":{"1min":0.97299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0510000000000002,"5min":55.969999999999999,"15min":55.969999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.329,"5min":2.1339999999999999,"15min":1.6559999999999999},"min":{"1min":0.98799999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.825,"5min":57.426000000000002,"15min":57.426000000000002},"last":1.079}]},{"osd":7,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.0880000000000001,"15min":1.6919999999999999},"min":{"1min":1.0940000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0310000000000001,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.6559999999999999,"5min":2.1930000000000001,"15min":1.7889999999999999},"min":{"1min":1.2769999999999999,"5min":1.0049999999999999,"15min":0.75600000000000001},"max":{"1min":1.9370000000000001,"5min":47.027000000000001,"15min":47.027000000000001},"last":1.6240000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":2.105,"15min":1.9590000000000001},"min":{"1min":1.0349999999999999,"5min":0.89600000000000002,"15min":0.65800000000000003},"max":{"1min":1.9490000000000001,"5min":47.246000000000002,"15min":50.509},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":2.262,"15min":2.165},"min":{"1min":1.2929999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2,"5min":46.308,"15min":50.698},"last":1.849}]},{"osd":9,"last update":"Fri Nov 20 11:46:01 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":2.391,"15min":1.9630000000000001},"min":{"1min":1.4019999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":4.8070000000000004,"5min":47.418999999999997,"15min":47.418999999999997},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.8080000000000001,"5min":2.3460000000000001,"15min":1.887},"min":{"1min":1.246,"5min":0.94699999999999995,"15min":0.78600000000000003},"max":{"1min":4.7839999999999998,"5min":47.543999999999997,"15min":47.543999999999997},"last":1.2070000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.73,"5min":2.617,"15min":3.093},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":0.98199999999999998},"max":{"1min":2.4140000000000001,"5min":47.140000000000001,"15min":47.140000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":2.5,"15min":3.0379999999999998},"min":{"1min":1.3280000000000001,"5min":1.0640000000000001,"15min":0.95599999999999996},"max":{"1min":2.0489999999999999,"5min":46.703000000000003,"15min":46.703000000000003},"last":1.583}]},{"osd":11,"last update":"Fri Nov 20 11:45:51 2020","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":2.4900000000000002,"15min":2.0510000000000002},"min":{"1min":1.4079999999999999,"5min":1.139,"15min":1.1160000000000001},"max":{"1min":2.1760000000000002,"5min":46.200000000000003,"15min":46.200000000000003},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.7,"5min":2.4769999999999999,"15min":2.0230000000000001},"min":{"1min":1.4019999999999999,"5min":1.286,"15min":1.127},"max":{"1min":2.0950000000000002,"5min":48.350000000000001,"15min":48.350000000000001},"last":1.752}]}]},{"osd":2,"up_from":17,"seq":73014444243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282928,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":282624,"kb_avail":94088912,"statfs":{"total":96636764160,"available":96347045888,"internally_reserved":0,"allocated":303104,"data_stored":136954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":289406976},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":4.9550000000000001,"5min":8.9930000000000003,"15min":6.2279999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":16.984000000000002,"5min":47.216000000000001,"15min":77.983000000000004},"last":1.4079999999999999},{"interface":"front","average":{"1min":5.7549999999999999,"5min":9.5549999999999997,"15min":6.3490000000000002},"min":{"1min":0.64800000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":28.588000000000001,"5min":44.024999999999999,"15min":78.215000000000003},"last":1.204}]},{"osd":3,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.96499999999999997,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63200000000000001},"max":{"1min":5.3460000000000001,"5min":7.7690000000000001,"15min":9.4440000000000008},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.105,"15min":1.161},"min":{"1min":0.70399999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5069999999999999,"5min":8.2140000000000004,"15min":9.6769999999999996},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":6.343,"5min":4.5300000000000002,"15min":3.9660000000000002},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.51900000000000002},"max":{"1min":92.447999999999993,"5min":92.447999999999993,"15min":92.447999999999993},"last":1.597},{"interface":"front","average":{"1min":6.7359999999999998,"5min":5.0519999999999996,"15min":4.3940000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.68000000000000005},"max":{"1min":92.543000000000006,"5min":92.543000000000006,"15min":92.543000000000006},"last":1.456}]},{"osd":5,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.3049999999999999,"15min":1.502},"min":{"1min":0.83499999999999996,"5min":0.69299999999999995,"15min":0.58599999999999997},"max":{"1min":5.7679999999999998,"5min":8.7469999999999999,"15min":11.797000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4330000000000001,"15min":1.615},"min":{"1min":0.94099999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.931,"5min":8.0950000000000006,"15min":10.281000000000001},"last":1.653}]},{"osd":6,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.411},"min":{"1min":0.749,"5min":0.68200000000000005,"15min":0.67500000000000004},"max":{"1min":2.762,"5min":7.5339999999999998,"15min":9.3119999999999994},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.5469999999999999,"15min":1.6180000000000001},"min":{"1min":0.86599999999999999,"5min":0.83899999999999997,"15min":0.73899999999999999},"max":{"1min":5.899,"5min":11.779,"15min":11.779},"last":1.141}]},{"osd":7,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.7030000000000001,"15min":1.9710000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.80000000000000004},"max":{"1min":18.559000000000001,"5min":18.559000000000001,"15min":77.819999999999993},"last":1.5469999999999999},{"interface":"front","average":{"1min":2.8149999999999999,"5min":1.819,"15min":2.0129999999999999},"min":{"1min":1.101,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":31.295999999999999,"5min":31.295999999999999,"15min":78.126999999999995},"last":1.351}]},{"osd":8,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.7629999999999999,"15min":1.8640000000000001},"min":{"1min":1.002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":6.5039999999999996,"5min":8.5489999999999995,"15min":11.343999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.756,"15min":2.0129999999999999},"min":{"1min":1.226,"5min":1.099,"15min":1.075},"max":{"1min":2.3610000000000002,"5min":8.6039999999999992,"15min":18.099},"last":1.2609999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.726,"15min":1.879},"min":{"1min":1.2609999999999999,"5min":1.083,"15min":1.0629999999999999},"max":{"1min":2.6150000000000002,"5min":8.3659999999999997,"15min":10.129},"last":1.754},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.655,"15min":1.7689999999999999},"min":{"1min":1.1439999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.411,"5min":7.7460000000000004,"15min":9.4220000000000006},"last":1.4730000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.9219999999999999,"15min":2.7349999999999999},"min":{"1min":1.361,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.6520000000000001,"5min":7.8650000000000002,"15min":78.016000000000005},"last":1.704},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.909,"15min":2.8220000000000001},"min":{"1min":1.238,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":6.3799999999999999,"5min":8.0250000000000004,"15min":77.741},"last":1.6830000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:45:53 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.8580000000000001,"15min":2.0369999999999999},"min":{"1min":1.3879999999999999,"5min":1.246,"15min":1.2190000000000001},"max":{"1min":2.4969999999999999,"5min":8.7319999999999993,"15min":10.26},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.849,"15min":1.9830000000000001},"min":{"1min":1.405,"5min":1.113,"15min":1.113},"max":{"1min":2.5230000000000001,"5min":8.0540000000000003,"15min":9.6440000000000001},"last":1.7909999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444243,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100968,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":100672,"kb_avail":94270872,"statfs":{"total":96636764160,"available":96533372928,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":103088128},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Fri Nov 20 11:45:55 2020","interfaces":[{"interface":"back","average":{"1min":4.1420000000000003,"5min":8.718,"15min":5.8630000000000004},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":19.181000000000001,"5min":109.33199999999999,"15min":109.33199999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":4.2060000000000004,"5min":8.9510000000000005,"15min":6.0069999999999997},"min":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":19.215,"5min":109.303,"15min":109.303},"last":1.232}]},{"osd":2,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.97099999999999997,"15min":1.496},"min":{"1min":0.64900000000000002,"5min":0.59599999999999997,"15min":0.54900000000000004},"max":{"1min":1.4239999999999999,"5min":3.3220000000000001,"15min":80.936999999999998},"last":1.411},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.208,"15min":1.5},"min":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"max":{"1min":1.3140000000000001,"5min":8.2599999999999998,"15min":80.414000000000001},"last":1.373}]},{"osd":4,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":5.1989999999999998,"5min":5.2290000000000001,"15min":4.1050000000000004},"min":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.622},"max":{"1min":85.147999999999996,"5min":85.147999999999996,"15min":85.147999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":5.2750000000000004,"5min":5.4850000000000003,"15min":4.2290000000000001},"min":{"1min":0.70299999999999996,"5min":0.64400000000000002,"15min":0.59299999999999997},"max":{"1min":85.228999999999999,"5min":85.228999999999999,"15min":85.228999999999999},"last":1.1279999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3560000000000001,"15min":1.6679999999999999},"min":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.63300000000000001},"max":{"1min":1.724,"5min":6.9329999999999998,"15min":81.069999999999993},"last":1.29},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2729999999999999,"15min":1.5880000000000001},"min":{"1min":0.74399999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"max":{"1min":1.603,"5min":6.6399999999999997,"15min":80.777000000000001},"last":1.2709999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3700000000000001,"15min":1.2929999999999999},"min":{"1min":0.70599999999999996,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6970000000000001,"5min":4.944,"15min":5.7060000000000004},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.5309999999999999,"15min":1.4239999999999999},"min":{"1min":0.876,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8600000000000001,"5min":10.449,"15min":10.449},"last":1.159}]},{"osd":7,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3620000000000001,"15min":1.337},"min":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66000000000000003},"max":{"1min":1.6890000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":1.343},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.522,"15min":1.4370000000000001},"min":{"1min":0.94699999999999995,"5min":0.81799999999999995,"15min":0.79300000000000004},"max":{"1min":2.073,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":1.107}]},{"osd":8,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5880000000000001,"15min":1.9370000000000001},"min":{"1min":1.024,"5min":0.94999999999999996,"15min":0.82199999999999995},"max":{"1min":1.9850000000000001,"5min":4.2190000000000003,"15min":80.457999999999998},"last":1.538},{"interface":"front","average":{"1min":1.425,"5min":1.6279999999999999,"15min":1.9750000000000001},"min":{"1min":1.05,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8180000000000001,"5min":8.1500000000000004,"15min":82.094999999999999},"last":1.4410000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.6419999999999999,"15min":1.659},"min":{"1min":1.093,"5min":0.98599999999999999,"15min":0.94199999999999995},"max":{"1min":2.0009999999999999,"5min":6.048,"15min":7.6509999999999998},"last":1.486},{"interface":"front","average":{"1min":1.611,"5min":1.6919999999999999,"15min":1.7290000000000001},"min":{"1min":1.3320000000000001,"5min":0.90900000000000003,"15min":0.84799999999999998},"max":{"1min":2.1040000000000001,"5min":4.3949999999999996,"15min":7.8940000000000001},"last":1.6559999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":2.0800000000000001,"15min":2.5089999999999999},"min":{"1min":1.2330000000000001,"5min":1.0780000000000001,"15min":1.048},"max":{"1min":6.125,"5min":16.952999999999999,"15min":21.556000000000001},"last":1.603},{"interface":"front","average":{"1min":1.671,"5min":1.9450000000000001,"15min":2.508},"min":{"1min":1.321,"5min":1.2470000000000001,"15min":1.1140000000000001},"max":{"1min":2.226,"5min":8.7739999999999991,"15min":22.158999999999999},"last":1.77}]},{"osd":11,"last update":"Fri Nov 20 11:45:50 2020","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.766,"15min":2.093},"min":{"1min":1.1259999999999999,"5min":1.0620000000000001,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":8.4969999999999999,"15min":81.783000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.895,"15min":2.153},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":1.117},"max":{"1min":2.198,"5min":7.1210000000000004,"15min":81.853999999999999},"last":1.726}]}]},{"osd":4,"up_from":17,"seq":73014444243,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377256,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":376960,"kb_avail":93994584,"statfs":{"total":96636764160,"available":96250454016,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":386007040},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":2.4350000000000001,"15min":2.5779999999999998},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.325,"5min":28.654,"15min":30.84},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":2.5880000000000001,"15min":2.3799999999999999},"min":{"1min":0.65000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5700000000000001,"5min":28.18,"15min":31.724},"last":0.754}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":8.0199999999999996,"5min":13.227,"15min":8.9049999999999994},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.64700000000000002},"max":{"1min":37.325000000000003,"5min":55.183999999999997,"15min":59.253},"last":1.022},{"interface":"front","average":{"1min":8.1029999999999998,"5min":13.624000000000001,"15min":10.289999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.61699999999999999},"max":{"1min":37.371000000000002,"5min":55.234999999999999,"15min":171.99199999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":2.2949999999999999,"15min":2.859},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"max":{"1min":2.302,"5min":19.934999999999999,"15min":31.109000000000002},"last":1.077},{"interface":"front","average":{"1min":1.1160000000000001,"5min":3.956,"15min":3.6259999999999999},"min":{"1min":0.82599999999999996,"5min":0.68000000000000005,"15min":0.67300000000000004},"max":{"1min":1.726,"5min":37.377000000000002,"15min":37.377000000000002},"last":1.228}]},{"osd":5,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":3.081,"15min":3.214},"min":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.5670000000000002,"5min":28.321000000000002,"15min":32.130000000000003},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.379,"5min":2.5819999999999999,"15min":3.7349999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.5390000000000001,"5min":25.385000000000002,"15min":31.341000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.0099999999999998,"15min":4.6829999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.66500000000000004},"max":{"1min":2.0329999999999999,"5min":44.808999999999997,"15min":62.055},"last":1.411},{"interface":"front","average":{"1min":1.5029999999999999,"5min":4.758,"15min":4.0759999999999996},"min":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.464,"5min":44.914999999999999,"15min":61.060000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":4.8559999999999999,"15min":4.7000000000000002},"min":{"1min":0.79400000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.9870000000000001,"5min":44.597000000000001,"15min":45.829999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.76,"5min":6.2519999999999998,"15min":4.7720000000000002},"min":{"1min":0.95899999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":6.4699999999999998,"5min":54.201000000000001,"15min":54.201000000000001},"last":1.552}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":7.1989999999999998,"15min":5.367},"min":{"1min":1.0309999999999999,"5min":0.878,"15min":0.878},"max":{"1min":2.5659999999999998,"5min":44.716000000000001,"15min":44.716000000000001},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.847,"5min":4.8700000000000001,"15min":4.8129999999999997},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.7489999999999997,"5min":44.753,"15min":44.753},"last":1.488}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":5.1970000000000001,"15min":4.1280000000000001},"min":{"1min":1.032,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.669,"5min":44.639000000000003,"15min":44.639000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":6.0030000000000001,"15min":5.2770000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.423,"5min":45.015999999999998,"15min":45.015999999999998},"last":1.6160000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":8.5739999999999998,"15min":7.6470000000000002},"min":{"1min":1.147,"5min":1.147,"15min":1.1339999999999999},"max":{"1min":4.0099999999999998,"5min":44.954000000000001,"15min":45.936},"last":1.927},{"interface":"front","average":{"1min":1.8169999999999999,"5min":6.6239999999999997,"15min":6.7519999999999998},"min":{"1min":1.1399999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.0309999999999997,"5min":44.784999999999997,"15min":50.340000000000003},"last":1.587}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":6.0190000000000001,"15min":5.4640000000000004},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":4.8710000000000004,"5min":44.881999999999998,"15min":44.881999999999998},"last":1.714},{"interface":"front","average":{"1min":1.665,"5min":8.1489999999999991,"15min":6.048},"min":{"1min":1.208,"5min":1.093,"15min":1.093},"max":{"1min":2.2919999999999998,"5min":53.826999999999998,"15min":53.826999999999998},"last":1.8100000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444243,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":201088,"kb_avail":94170456,"statfs":{"total":96636764160,"available":96430546944,"internally_reserved":0,"allocated":294912,"data_stored":136379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":205914112},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.101,"15min":1.0580000000000001},"min":{"1min":0.65400000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2929999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.089,"15min":1.0549999999999999},"min":{"1min":0.65100000000000002,"5min":0.62,"15min":0.60699999999999998},"max":{"1min":1.234,"5min":5.665,"15min":5.665},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":7.9820000000000002,"15min":6.2060000000000004},"min":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.63500000000000001},"max":{"1min":14.426,"5min":37.024999999999999,"15min":95.546999999999997},"last":1.5920000000000001},{"interface":"front","average":{"1min":3.0659999999999998,"5min":7.8879999999999999,"15min":5.9630000000000001},"min":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":14.476000000000001,"5min":38.518000000000001,"15min":94.667000000000002},"last":1.2989999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.613,"15min":1.4990000000000001},"min":{"1min":0.68500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.647,"5min":22.68,"15min":22.68},"last":1.177},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.552,"15min":1.371},"min":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.64400000000000002},"max":{"1min":1.3700000000000001,"5min":28.699999999999999,"15min":28.699999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":3.1179999999999999,"15min":4.0350000000000001},"min":{"1min":0.90500000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.992,"5min":19.047999999999998,"15min":92.614999999999995},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.286,"5min":3.0830000000000002,"15min":4.2560000000000002},"min":{"1min":1.0780000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.657,"5min":18.266999999999999,"15min":93.894000000000005},"last":1.5409999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.6679999999999999,"15min":1.657},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.629},"max":{"1min":2.1389999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":1.026,"5min":1.006,"15min":0.91000000000000003},"max":{"1min":1.788,"5min":10.125,"15min":10.125},"last":1.3819999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.593,"15min":1.601},"min":{"1min":0.96999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7070000000000001,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.841,"15min":1.867},"min":{"1min":1.161,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.2559999999999998,"5min":10.981999999999999,"15min":10.981999999999999},"last":1.6200000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1349999999999998},"min":{"1min":1.302,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.3279999999999998,"5min":9.8010000000000002,"15min":45.292999999999999},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.623,"5min":2.0409999999999999,"15min":2.2389999999999999},"min":{"1min":1.3340000000000001,"5min":1.1830000000000001,"15min":1.0660000000000001},"max":{"1min":1.966,"5min":10.221,"15min":45.390000000000001},"last":1.899}]},{"osd":9,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.9590000000000001,"15min":2.0880000000000001},"min":{"1min":1.3720000000000001,"5min":1.3180000000000001,"15min":1.202},"max":{"1min":2.056,"5min":9.9979999999999993,"15min":45.686999999999998},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.774,"15min":1.758},"min":{"1min":1.169,"5min":1.0760000000000001,"15min":0.93799999999999994},"max":{"1min":1.7509999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":1.2589999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.9790000000000001,"15min":3.4340000000000002},"min":{"1min":1.276,"5min":1.153,"15min":1.103},"max":{"1min":2.5539999999999998,"5min":8.7330000000000005,"15min":96.786000000000001},"last":1.708},{"interface":"front","average":{"1min":1.661,"5min":2.105,"15min":3.5550000000000002},"min":{"1min":1.331,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.3999999999999999,"5min":10.847,"15min":95.569999999999993},"last":1.78}]},{"osd":11,"last update":"Fri Nov 20 11:45:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":2.1509999999999998,"15min":2.2490000000000001},"min":{"1min":1.419,"5min":1.3680000000000001,"15min":1.1990000000000001},"max":{"1min":2.1859999999999999,"5min":15.747,"15min":45.524000000000001},"last":2.0310000000000001},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.9650000000000001,"15min":2.137},"min":{"1min":1.3560000000000001,"5min":1.1679999999999999,"15min":1.163},"max":{"1min":1.8740000000000001,"5min":9.843,"15min":45.317999999999998},"last":1.8180000000000001}]}]}]}} 2020-11-20T11:46:47.476 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T11:46:47.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.592+0000 7f696c64d700 1 Processor -- start 2020-11-20T11:46:47.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.592+0000 7f696c64d700 1 -- start start 2020-11-20T11:46:47.598 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696c64d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f696409ad30 0x7f69640c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696c64d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640bde30 con 0x7f69640c37f0 2020-11-20T11:46:47.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696c64d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696414de60 con 0x7f696414b410 2020-11-20T11:46:47.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696c64d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640beae0 con 0x7f696409ad30 2020-11-20T11:46:47.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696a3e9700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f696414b410 0x7f6964065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42300/0 (socket says 172.21.15.105:42300) 2020-11-20T11:46:47.599 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f696a3e9700 1 -- 172.21.15.105:0/1757527114 learned_addr learned my addr 172.21.15.105:0/1757527114 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-11-20T11:46:47.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f6969be8700 1 --2- 172.21.15.105:0/1757527114 >> v2:172.21.15.100:3300/0 conn(0x7f696409ad30 0x7f69640c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 <== mon.2 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493217058 0 0) 0x7f695c001450 con 0x7f696414b410 2020-11-20T11:46:47.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.593+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003240 con 0x7f696414b410 2020-11-20T11:46:47.600 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 <== mon.2 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1577820455 0 0) 0x7f694c003240 con 0x7f696414b410 2020-11-20T11:46:47.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f6969be8700 1 -- 172.21.15.105:0/1757527114 >> v1:172.21.15.105:6789/0 conn(0x7f696414b410 legacy=0x7f6964065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f6969be8700 1 -- 172.21.15.105:0/1757527114 >> v1:172.21.15.100:6789/0 conn(0x7f69640c37f0 legacy=0x7f696414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f6969be8700 1 -- 172.21.15.105:0/1757527114 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640be060 con 0x7f696409ad30 2020-11-20T11:46:47.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f6969be8700 1 --2- 172.21.15.105:0/1757527114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696409ad30 0x7f69640c3300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f695400b990 tx=0x7f6954006d90).ready entity=mon.1 client_cookie=9b484a0a60cb315c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.601 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0019f0 con 0x7f696409ad30 2020-11-20T11:46:47.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540094a0 con 0x7f696409ad30 2020-11-20T11:46:47.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f69693e7700 1 -- 172.21.15.105:0/1757527114 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400bee0 con 0x7f696409ad30 2020-11-20T11:46:47.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f696c64d700 1 -- 172.21.15.105:0/1757527114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696409ad30 msgr2=0x7f69640c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f696c64d700 1 --2- 172.21.15.105:0/1757527114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696409ad30 0x7f69640c3300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f695400b990 tx=0x7f6954006d90).stop 2020-11-20T11:46:47.602 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f696c64d700 1 -- 172.21.15.105:0/1757527114 shutdown_connections 2020-11-20T11:46:47.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.594+0000 7f696c64d700 1 --2- 172.21.15.105:0/1757527114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696409ad30 0x7f69640c3300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.595+0000 7f696c64d700 1 -- 172.21.15.105:0/1757527114 >> 172.21.15.105:0/1757527114 conn(0x7f69640b9890 msgr2=0x7f69640b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:47.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.595+0000 7f696c64d700 1 -- 172.21.15.105:0/1757527114 shutdown_connections 2020-11-20T11:46:47.603 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.595+0000 7f696c64d700 1 -- 172.21.15.105:0/1757527114 wait complete. 2020-11-20T11:46:47.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 Processor -- start 2020-11-20T11:46:47.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 -- start start 2020-11-20T11:46:47.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.606 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69640c37f0 0x7f696413f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696414b410 0x7f696413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964160970 con 0x7f696414b410 2020-11-20T11:46:47.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964160ba0 con 0x7f69640c37f0 2020-11-20T11:46:47.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696c64d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964160e40 con 0x7f696409ad30 2020-11-20T11:46:47.607 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696a3e9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696a3e9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42702/0 (socket says 172.21.15.105:42702) 2020-11-20T11:46:47.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.596+0000 7f696a3e9700 1 -- 172.21.15.105:0/1517938007 learned_addr learned my addr 172.21.15.105:0/1517938007 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-11-20T11:46:47.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f6969be8700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69640c37f0 0x7f696413f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696abea700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696414b410 0x7f696413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.608 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 -- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69640c37f0 msgr2=0x7f696413f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69640c37f0 0x7f696413f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 -- 172.21.15.105:0/1517938007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696414b410 msgr2=0x7f696413fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696414b410 0x7f696413fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 -- 172.21.15.105:0/1517938007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69641610e0 con 0x7f696409ad30 2020-11-20T11:46:47.609 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696a3e9700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f695c00ce60 tx=0x7f695c001210).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00ac10 con 0x7f696409ad30 2020-11-20T11:46:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6964161380 con 0x7f696409ad30 2020-11-20T11:46:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00ad70 con 0x7f696409ad30 2020-11-20T11:46:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c007380 con 0x7f696409ad30 2020-11-20T11:46:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.597+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6964140260 con 0x7f696409ad30 2020-11-20T11:46:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.598+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69641617e0 con 0x7f696409ad30 2020-11-20T11:46:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.598+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f695c010070 con 0x7f696409ad30 2020-11-20T11:46:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.599+0000 7f69527fc700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 0x7f693c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:46:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.599+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f695c0a28b0 con 0x7f696409ad30 2020-11-20T11:46:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.599+0000 7f6969be8700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 0x7f693c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:46:47.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.599+0000 7f6969be8700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 0x7f693c082b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f695400b990 tx=0x7f69640ba3b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:46:47.612 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.602+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f695c0772c0 con 0x7f696409ad30 2020-11-20T11:46:47.780 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.777+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f696414de60 con 0x7f696409ad30 2020-11-20T11:46:47.785 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.781+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f695c007730 con 0x7f696409ad30 2020-11-20T11:46:47.787 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.783+0000 7f69527fc700 1 -- 172.21.15.105:0/1517938007 <== mon.2 v2:172.21.15.105:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f696414de60 con 0x7f696409ad30 2020-11-20T11:46:47.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 msgr2=0x7f693c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.789 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 0x7f693c082b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f695400b990 tx=0x7f69640ba3b0).stop 2020-11-20T11:46:47.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 msgr2=0x7f6964149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:46:47.790 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f695c00ce60 tx=0x7f695c001210).stop 2020-11-20T11:46:47.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 shutdown_connections 2020-11-20T11:46:47.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696414b410 0x7f696413fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.791 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:6800/24394,v1:172.21.15.100:6801/24394] conn(0x7f693c080660 0x7f693c082b20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696409ad30 0x7f6964149480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.784+0000 7f696c64d700 1 --2- 172.21.15.105:0/1517938007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69640c37f0 0x7f696413f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:46:47.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.785+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 >> 172.21.15.105:0/1517938007 conn(0x7f69640b9890 msgr2=0x7f69641405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:46:47.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.785+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 shutdown_connections 2020-11-20T11:46:47.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-11-20T11:46:47.785+0000 7f696c64d700 1 -- 172.21.15.105:0/1517938007 wait complete. 2020-11-20T11:46:47.801 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T11:46:47.803 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T11:46:47.803 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:47.812 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T11:46:47.813 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T11:46:47.813 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:52.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-11-20T11:46:53.916 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T11:46:53.916 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-11-20T11:46:53.917 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:53.950 INFO:tasks.ceph.mds.c:Stopped 2020-11-20T11:46:53.950 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T11:46:53.951 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T11:46:53.951 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:53.994 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T11:46:53.994 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T11:46:53.995 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:54.054 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T11:46:54.055 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T11:46:54.055 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:54.152 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T11:46:54.152 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2020-11-20T11:46:54.153 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:54.251 INFO:tasks.ceph.osd.9:Stopped 2020-11-20T11:46:54.251 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T11:46:54.252 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:54.350 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T11:46:54.352 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T11:46:54.352 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:46:58.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2020-11-20T11:46:58.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-11-20T11:47:00.455 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T11:47:00.455 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T11:47:00.456 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.525 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T11:47:00.525 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2020-11-20T11:47:00.526 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.603 INFO:tasks.ceph.osd.10:Stopped 2020-11-20T11:47:00.604 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T11:47:00.604 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.703 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T11:47:00.704 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T11:47:00.704 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.786 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T11:47:00.786 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2020-11-20T11:47:00.787 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.875 INFO:tasks.ceph.osd.8:Stopped 2020-11-20T11:47:00.877 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2020-11-20T11:47:00.879 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.943 INFO:tasks.ceph.osd.11:Stopped 2020-11-20T11:47:00.944 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T11:47:00.945 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T11:47:00.945 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.964 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T11:47:00.965 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T11:47:00.965 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:00.989 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T11:47:00.990 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2020-11-20T11:47:00.990 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:01.006 INFO:tasks.ceph.mgr.z:Stopped 2020-11-20T11:47:01.007 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T11:47:01.007 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T11:47:01.008 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:01.022 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T11:47:01.025 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T11:47:01.026 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:01.046 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T11:47:01.047 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T11:47:01.049 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:47:01.064 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T11:47:01.065 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T11:47:01.066 INFO:teuthology.orchestra.run.smithi105:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2020-11-20T11:47:01.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:47:01.412 INFO:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T11:47:03.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:47:03.094 INFO:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T11:47:03.280 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:47:03.281 INFO:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T11:47:03.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi105.front.sepia.ceph.com 2020-11-20T11:47:03.410 INFO:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2020-11-20T11:47:03.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:47:03.536 INFO:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T11:47:03.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2020-11-20T11:47:06.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:47:06.496 INFO:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T11:47:06.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:47:06.739 INFO:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T11:47:06.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi100.front.sepia.ceph.com 2020-11-20T11:47:06.888 INFO:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2020-11-20T11:47:07.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:47:07.040 INFO:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T11:47:07.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:47:07.629 INFO:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T11:47:07.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:47:07.787 INFO:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2020-11-20T11:47:07.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi067.front.sepia.ceph.com 2020-11-20T11:47:07.860 INFO:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2020-11-20T11:47:07.993 INFO:tasks.ceph:Archiving mon data... 2020-11-20T11:47:07.995 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/data/mon.a.tgz 2020-11-20T11:47:07.995 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-11-20T11:47:08.027 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.DC2qcFxDVG 2020-11-20T11:47:08.027 INFO:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DC2qcFxDVG 2020-11-20T11:47:08.809 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.DC2qcFxDVG 2020-11-20T11:47:08.975 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.DC2qcFxDVG is 4MB 2020-11-20T11:47:09.132 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.DC2qcFxDVG 2020-11-20T11:47:09.147 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/data/mon.b.tgz 2020-11-20T11:47:09.147 INFO:teuthology.orchestra.run.smithi100:> mktemp 2020-11-20T11:47:09.185 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.sU85bfdiwv 2020-11-20T11:47:09.186 INFO:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.sU85bfdiwv 2020-11-20T11:47:09.967 INFO:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.sU85bfdiwv 2020-11-20T11:47:10.178 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.sU85bfdiwv is 4MB 2020-11-20T11:47:10.328 INFO:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.sU85bfdiwv 2020-11-20T11:47:10.343 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/data/mon.c.tgz 2020-11-20T11:47:10.344 INFO:teuthology.orchestra.run.smithi067:> mktemp 2020-11-20T11:47:10.389 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.bLU9NvYqzn 2020-11-20T11:47:10.390 INFO:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bLU9NvYqzn 2020-11-20T11:47:11.209 INFO:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.bLU9NvYqzn 2020-11-20T11:47:11.340 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.bLU9NvYqzn is 4MB 2020-11-20T11:47:11.531 INFO:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.bLU9NvYqzn 2020-11-20T11:47:11.553 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T11:47:11.554 INFO:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:47:11.603 INFO:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:47:11.608 INFO:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:47:11.717 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T11:47:11.717 INFO:teuthology.orchestra.run.smithi105:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:47:11.731 INFO:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:47:11.735 INFO:teuthology.orchestra.run.smithi067:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:47:11.768 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:47:11.787 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:47:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:47:11.829 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T11:47:11.840 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/remote/smithi105/crash 2020-11-20T11:47:11.844 INFO:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:47:11.885 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/remote/smithi100/crash 2020-11-20T11:47:11.888 INFO:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:47:11.923 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/remote/smithi067/crash 2020-11-20T11:47:11.937 INFO:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:47:11.973 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T11:56:46.432 INFO:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:46.510 INFO:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:46.557 INFO:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:46.626 INFO:tasks.ceph:Compressing logs... 2020-11-20T11:56:46.627 INFO:teuthology.orchestra.run.smithi067:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T11:56:46.629 INFO:teuthology.orchestra.run.smithi100:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T11:56:46.632 INFO:teuthology.orchestra.run.smithi105:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T11:56:46.635 INFO:tasks.ceph:Archiving logs... 2020-11-20T11:56:46.637 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/remote/smithi105/log 2020-11-20T11:56:46.638 INFO:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/log/ceph -- . 2020-11-20T12:01:12.198 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-osd.6.log: file changed as we read it 2020-11-20T12:01:13.322 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27770.log: File removed before we read it 2020-11-20T12:01:13.322 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph.audit.log: File removed before we read it 2020-11-20T12:01:13.322 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36536.log: File removed before we read it 2020-11-20T12:01:13.322 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27476.log: File removed before we read it 2020-11-20T12:01:13.323 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37593.log: File removed before we read it 2020-11-20T12:01:13.323 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37166.log: File removed before we read it 2020-11-20T12:01:13.323 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36452.log: File removed before we read it 2020-11-20T12:01:13.323 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37292.log: File removed before we read it 2020-11-20T12:01:13.323 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37334.log: File removed before we read it 2020-11-20T12:01:13.324 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28568.log: File removed before we read it 2020-11-20T12:01:13.324 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36746.log: File removed before we read it 2020-11-20T12:01:13.324 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27938.log: File removed before we read it 2020-11-20T12:01:13.324 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29342.log: File removed before we read it 2020-11-20T12:01:13.324 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37208.log: File removed before we read it 2020-11-20T12:01:13.325 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36620.log: File removed before we read it 2020-11-20T12:01:13.325 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28064.log: File removed before we read it 2020-11-20T12:01:13.325 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36956.log: File removed before we read it 2020-11-20T12:01:13.325 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.30227.log: File removed before we read it 2020-11-20T12:01:13.325 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36321.log: File removed before we read it 2020-11-20T12:01:59.915 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-mon.a.log: File removed before we read it 2020-11-20T12:01:59.915 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28904.log: File removed before we read it 2020-11-20T12:01:59.915 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27980.log: File removed before we read it 2020-11-20T12:01:59.916 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29174.log: File removed before we read it 2020-11-20T12:01:59.916 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28148.log: File removed before we read it 2020-11-20T12:01:59.916 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28232.log: File removed before we read it 2020-11-20T12:01:59.916 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29636.log: File removed before we read it 2020-11-20T12:01:59.917 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36662.log: File removed before we read it 2020-11-20T12:01:59.917 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27392.log: File removed before we read it 2020-11-20T12:01:59.917 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37082.log: File removed before we read it 2020-11-20T12:01:59.917 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37250.log: File removed before we read it 2020-11-20T12:01:59.918 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28484.log: File removed before we read it 2020-11-20T12:01:59.918 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27434.log: File removed before we read it 2020-11-20T12:01:59.918 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37511.log: File removed before we read it 2020-11-20T12:01:59.918 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29132.log: File removed before we read it 2020-11-20T12:01:59.918 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29300.log: File removed before we read it 2020-11-20T12:01:59.919 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36578.log: File removed before we read it 2020-11-20T12:01:59.919 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-mds.a.log: File removed before we read it 2020-11-20T12:01:59.919 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27896.log: File removed before we read it 2020-11-20T12:01:59.919 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36914.log: File removed before we read it 2020-11-20T12:01:59.920 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28274.log: File removed before we read it 2020-11-20T12:01:59.920 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36410.log: File removed before we read it 2020-11-20T12:01:59.920 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27518.log: File removed before we read it 2020-11-20T12:01:59.920 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28652.log: File removed before we read it 2020-11-20T12:01:59.920 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28400.log: File removed before we read it 2020-11-20T12:01:59.921 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28946.log: File removed before we read it 2020-11-20T12:01:59.921 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-mgr.x.log: File removed before we read it 2020-11-20T12:01:59.921 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29678.log: File removed before we read it 2020-11-20T12:01:59.921 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.30059.log: File removed before we read it 2020-11-20T12:01:59.922 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph.log: File removed before we read it 2020-11-20T12:01:59.922 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27270.log: File removed before we read it 2020-11-20T12:01:59.922 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36830.log: File removed before we read it 2020-11-20T12:01:59.922 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27330.log: File removed before we read it 2020-11-20T12:01:59.922 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-osd.0.log: File removed before we read it 2020-11-20T12:01:59.923 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28820.log: File removed before we read it 2020-11-20T12:01:59.923 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28694.log: File removed before we read it 2020-11-20T12:01:59.923 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37419.log: File removed before we read it 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-osd.3.log: file changed as we read it 2020-11-20T12:02:30.980 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.30143.log: File removed before we read it 2020-11-20T12:02:30.981 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27560.log: File removed before we read it 2020-11-20T12:02:30.981 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36872.log: File removed before we read it 2020-11-20T12:07:16.855 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-osd.9.log: file changed as we read it 2020-11-20T12:07:18.074 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28778.log: File removed before we read it 2020-11-20T12:07:18.074 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.30017.log: File removed before we read it 2020-11-20T12:07:18.074 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29510.log: File removed before we read it 2020-11-20T12:07:18.075 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37553.log: File removed before we read it 2020-11-20T12:09:34.574 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28022.log: File removed before we read it 2020-11-20T12:09:34.597 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29090.log: File removed before we read it 2020-11-20T12:09:34.597 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37124.log: File removed before we read it 2020-11-20T12:09:34.598 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.37461.log: File removed before we read it 2020-11-20T12:09:34.598 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29384.log: File removed before we read it 2020-11-20T12:09:34.598 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28442.log: File removed before we read it 2020-11-20T12:09:34.598 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27644.log: File removed before we read it 2020-11-20T12:09:34.598 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.30185.log: File removed before we read it 2020-11-20T12:09:34.599 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28736.log: File removed before we read it 2020-11-20T12:09:34.611 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28862.log: File removed before we read it 2020-11-20T12:09:34.611 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27728.log: File removed before we read it 2020-11-20T12:09:34.611 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36368.log: File removed before we read it 2020-11-20T12:09:34.612 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36788.log: File removed before we read it 2020-11-20T12:09:34.612 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29258.log: File removed before we read it 2020-11-20T12:09:34.612 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29594.log: File removed before we read it 2020-11-20T12:09:34.612 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27686.log: File removed before we read it 2020-11-20T12:09:34.613 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.28106.log: File removed before we read it 2020-11-20T12:09:34.613 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.36704.log: File removed before we read it 2020-11-20T12:10:37.973 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.29216.log: File removed before we read it 2020-11-20T12:10:38.002 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./ceph-client.admin.27230.log: File removed before we read it 2020-11-20T12:10:38.002 INFO:teuthology.orchestra.run.smithi105.stderr:tar: .: file changed as we read it 2020-11-20T12:10:38.010 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640245/remote/smithi100/log 2020-11-20T12:10:38.012 INFO:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/log/ceph -- . 2020-11-20T12:12:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:tar: ./ceph-osd.1.log.gz: file changed as we read it 2020-11-20T12:20:05.340 INFO:teuthology.orchestra.run.smithi100.stderr:tar: ./ceph-osd.1.log: file changed as we read it 2020-11-20T12:20:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:tar: ./ceph.log: File removed before we read it